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OBJECT IVES 

Vn i s pro je ;t including amendments and extensions was les 5 gned Co meet 
the following two summary objectives: 

A. To Produce a Manual for Educatio nal Knowledge L in king Change Agents 

1 . To pr spare a useful reference manual on the dissemination and 
utilisation process for the practicing knowledge linker in 
education, building on the literature review on dissemination 
and utilization entitled PLANNING FOR INNOVATION, ED #0291/1. 

2. To conpare alternative contents and formats for such a field 
manual on the criterion of perceived usefulness by linkers. 

3. To mate a full revision of the manual based on reviews by 100 
representative linkers, this revision to include special 
Introductory statements for administrators and other typical 
users and an extended presentation on the role of change agent. 

^ . To prjpare checklist summaries of major component, of the 

manual for future use as a workbook or as field instruments. 

b. To Dev elop Plans and Designs For the Training of Educational Knowledge 
Li n k 1 ncj^ C h ange Agents 

1. To crfate an awareness and involvement In the problem of change 
agent training by relevant segments of the educational community. 

2. To prjpare alternative training designs for such change agents, 
spec i : y i ng : 

a. Identification and recruitment of appropriate 
individuals for training, 

b. training workshop design (materials, structure, 
staffing, funding), 

c. support materials for continuing use by trained 
agents (manuals, instruments, readings, etc.), 

d. : ollowup consultation and evaluation activities 
and personnel required to staff a total on-going 
srogram. 

Most of the resources of the project were assigned to these two major 
tasks (A and B) , but the project also called for some support of further refine 
merit of u { i 1 i za : i on theory along the lines of the "linkage model" proposed by 
Havelock In his previous report: PLANNING FOR INNOVATION. 
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OBJECTIVES 



The Manual 



A manua'i of over 200 pages has been produced according to the process 
‘oecified in the proposal. An early draft version (prototype #1) w. ■ 
evaluated intensively by a small group of representative change agents. As 
a result of this collaboration a second working draft (prototype it 2) was 
•‘Ouuced including cose studies from these change agents. Prototype tfl 
was reviewed intensively and evaluated by 115 educators chosen systematically 
to represent perotypical future users of the manual. The response was over- 
whelmingly favorable and in addition provided a quantity of information which 
'.-'uld be used ftr developing a third revision (prototype it 3). 

Subsequently the manual, under the title "A Guide to Innovation in 
Education" has teen distributed by The Institute for Social Research on a 
limited basis urder a developmental copy r ' ght from USOE so that It could be 
v; i d at cost anc used in a number of university courses, in-service workshops, 
niici conferences. The feedback from this controlled dissemination has indicated 
that the "Guide 1 can be an important tool in training and in orogram manage- 
ment in a variety of educational practice settings. 

The "Guide 1 has now been further revised in accordance with objective A- 3 
to include a brief introduction for administrators and a greatly expanded 
section explaining the concept of "resource linker" and two other alternative 
change agent corcepts, the "catalyst" and the "solution giver." Additional 
sections are now being written and all three appendices revised and up-dated 
using non- f edert 1 funds in preparation for final publication. Negotiations are 
under way with E ducational Techno 1 ogy Publications, Inc. which has expressed a 
.esire to publish the final version. 

Checklists have been prepared for key portions of the text in accordance 
'/'th objective A-4. However these instruments have not yet been field tested 
so that their ui i 1 i ty is still a matter of conjecture. It is anticipated that 
before such materials can be used as reliable tools of change planning, they 
will require sexeral cycles of development parallel to that of the "Guide. 1 ' 

3 , Training Dt signs 

On May 25 :o 27, 1970, 51 nationally recognized leaders in the field of 
c usage agent training were brought together at Clinton, Michigan to discuss 
trie critical issues relevant to the content and procedures for such training. 

The conference, itself, was an intensive learning experience for those involved 
and represented a major dissemination thrust for the "Guide" and for the need 
for new resource linking change agent roles. However, the conference also 
produced a number of specific, through tentative, training designs for different 
conceptions of :he role. These are incorporated as Part V of the manual 
described below 

! he primar' 1 products relevant to the achievement of objective B-2 have 
been assembled n the form of a manual for training program developers. This 
manual includes sections on knowledge content to be trained, goals' of training, 
principles of training, an eight-part systematic framework for designing 
comprehensive programs, and several presentations of alternative training models 
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nr0p0 v-3d by self-selected subgroups at the Michigan conference. Finally, 
;r , Hluja | includes a fully developed outline for training state agency change 
' s a ' n t . Plans for publication and distribution of this manual on training 
n ot b«?f-n fully formulated but it: is expected that further revisions w 
Sh made using ron-federal funds and that the Institute for Social Research 
publications of f ice will make the document widely available. 



CONTENTS OF THIS REPORT 

This final report consists of three sections and four attachments as 

*-'o 1 i ows 



ection I Narrative History of the Project including development 
rycUs of the "Guide," design, conduct, and outcomes of the 
Michigan Conference on Educational Change Agent Training 
(CEC/.T) and subsequent dissemination and training activities 



iec l i on 






valuation of the Gu l do (Prototype IIS) by 
a summary report based on returned data 



/ l 5 chance 



Section I I Evaluation of CECAT based on post-conference reactions 
of participants. 

Attachmen : #1 A Guide to Innovation in Education (Prototype ft 3) 
plus revised and expanded introductory section. 

Attachmen: #2 Checklists on Change Process intended to accompany the 
"Guide." 



Attachmen : #3 A Preliminary Version of a Manual on Educational 
Change Agent Training. 

Attachmen: ffh "Anatomy of a Communication Arc": a sample of work 
partially supported under this contract to spell out theory 
of uiilization in more precise terms. This work is still in 

p rog *ess . 
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'•notion { : H I ST C ■ ' OF THE PROJECT 
A . f- ackgrounc and Rationale * 

The 1 3 60 1 i saw the emergence of a new awareness that research by itself 
ot provice direct answers to the problems faced in the practical 
world, and this awareness nas been articulated in the formation of a new 
. ; ' • c i n 1 i ne foci ssed on the problem of knowledge dissemination and utilization. 
Research studies of the dissemination-utilization process were virtually non- 
eni stent prior to World War II and were restricted largely to the area of 
r i cul tural ir novations until a decade ago. Increasingly in recent years, 
fowever. there has been evidenced a dramatic growth of interest in this 
!?./; i c in such lields as public health, mental health, medicine, international 
development, ar d in particular education. 

Together with this growing interest in dissemination and utilization as 
a research concern have come increasing efforts to establish dissemination 
networks, new toles, and institutions designed specifically to speed the flow 
o r knowledge from research to practice, U.S. education has been in the fore- 
front of this Innovative trend. Starting with major federal legislation on 
education in tie early 1960's, there has been a very rapid growth of research 
and developmeni centers, information clearinghouses, regional laboratories 
find locally based and regionally based dissemination projects, conferences, 
and training programs, all geared generally to the same end of up-grading 
education by ir fusing in the practicing school system new ideas and 
innovations ba;ed on research knowledge. 

Tills proliferation of institutional forms has been so rapid that in 
nearly all cases ft has preceded the development of adequate role definitions 
and adequate tiaining and support activities and materials for these new roles. 
Practically overnight, thousands of new knowledge linking roles (disseminators, 
consultants, demonstrators, etc) have been created and filled by people who 
nave only a vacua conception of what the role is and no real way of preparing 
Jiemselves and supplying themselves with the appropriate knowledge and materials 
f o r occupy i ng he role. 

Major coni r i but i ons toward defining and publicizing the need for the 
linker role in education were made by Clark and Hopkins (1966 a & b) when they 
developed a taxonomy of linkage roles as a part of their study of "Roles for 
Research, Deve opment and Diffusion Personnel in Education," They saw specialized 
diffusion role:, as an essential accompaniment to the roles related to research 
and developmen . in education and further study convinced them that the demand 
for persons to fill these roles would be tremendous in the not-so-d i s tant 
future , 

The institutionalization of linking roles in education is urgently needed 
to satisfy this growing demand and to assist in coordinating linking functions 
so tnat role overload and marginal i ty , current major causes of linking failure, 
do not become :otal!y nullifying forces in knowledge diffusion in education. 

The primary considerations for establishing and training personnel In linking 
roles are out! ned by Havelock, et al ( 1 969 , Chapter 7) ■ 

-Much of this material is adapted from the original proposal statement. 
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o provide adequate support for these emerging j inking roles in 
eciue?. i on . the educational establishment will have to provide training 
courses and field handbooks and manuals not only in specific content areas 
vici* as reading, guidance, administration, and curriculum but also in the 
r: ,i processes of disseminating and installing innovations, planning of 
and facl itating the flow of knowledge from research to practice. 

; project was intended as one contribution to this difficult but essential 
r-'cs’s. ‘Building on an extensive review of the d : ’ semi nat i on and utilization 
literature (Have ock, et al , 1969), we set out to create a field manual for the 
.■ :oe i. : c i ng knowledge linker in education. it was felt, however, that such a 
•; would be successful only if it were developed col laborati vely with a 

••>p*-esontat i ve sample of these linking agents. Later phases of the project 

be concerned with further revision and extension of the field manual and 
e. .tab! i shmerr of training programs to familiarize linkers with its contents 
-'d potential uses. it was felt that through such programs some strong new role 
• • -u g e i would cook i into being through educators who were beginning to develop an 
i dent tv and a defined area of expertise as resource linkers. 



How the Gui ■ ie was C reafed : C ycles of Dev el op men i. 

1 • Revi *?h) of Past Efforts and Development of a Proposal 

This p -oject began with a need expressed by the Office of Education 
for a companion work to the extensive compendium ar.d anal', is of findings 
on dissemination and utilization (Havelock, et al, 1969), While this work was 
still in progress it was already obvious that Its primary audiences would be 
researchers and policy planners who had the sophistication, patience, and 
motivation :o derive their own implications. What about the busy administrator 
t practitioner who needed practical help on knowledge retrieval and utilization? 
Was It not possible to develop some practical guide for this broader and less 
research-or ented audience so that the substantial existing research and theory 
in this are. i could be put to more immediate practical use? 

A firs : step was to look for models of such an effort. Had anyone tried 
"o do this before and how well had they succeeded? In 1958, Lippi tt, Watson, 
and West ley had published a volume entitled The Dynam i cs of Planned Change . 

I his book was well written, summarized a good deal of existing research, and 
was directed broadly at practitioners of change. However, it was still largely 
theoretical-analytical in approach; if did not draw specific implications for 
specific situations; it contained few clearly specified " J o's" and "don'ts": 
it was In no sense a “how to" manual. Furthermore, The Dynamics of Planned Ch ange 
was not systematical ly evaluated by any group of change agents - for its ut i 1 i ty”'™ 
or effectiveness before final dissemination. A more recent effort by Thomas E, 
Woods, The Admi ni stration of Educational Innovation ( 1967) does a fine and 
concise job of summarizing the rich literature on the diffusion of innovations 
(touched only lightly by Lippi 1 1 » et al) providing it in pamphlet size in 
the language; that a busy practitioner might understand and absorb. But Woods' 
effort likevnse was not tried out and evaluated on a practitioner audience and 
probably docs not have enough depth to be considered a manual on change. 
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in sea'ching for projects which tried to develop information 
Products ac :ording to a systematic evaluation and development plan 
we came across a study of the comparative effectiveness of several 
kinds of communication media, done in the field of vocational rehabi- 
litation (G aser, 1367)- A single message about an effective innovation 
was transmi :ted by different rued i a to several matched audiences and their 
adoptive be lavior was compared. Glaser found that the written communication 
alone was sufficient for diffusing knowledge of the innovation, but that 
the additioi of a demonstration conference or consulting activities 
significant y increased its actual adoption . The key variable here was 
the opportunity for the receiver to g've feedback to the sender about 
his evaluat on of the new idea in terms of h i s own experience. These 
results suggested that various mechanisms, conferences, interviews, 
evaluation "arms, and consultations might be needed (a) to develop a 
product tha : was mean! igful and useful to the intended audience, and 
(b) to diffjse the product once it was developed. 

A I thou jh the use of a training package for disseminating experimentally- 
based or iniovative programs to practitioners is common, as are studies of 
their effectiveness, their diffusion potential is limited because these 
programs ha /e generally dealt with specific innovations, have been 
developed i i response to requests from specific audiences, and have been 
designed to solve the unique problems of their respective situations. 

Such was s h • purpose of the social science curriculum development 
studies of . i p ( itt and Fox (1964). The same limitations apply in lesser 
degree to R ' ch land ‘ s "traveling seminar" (1965) for educational innova- 
tion d iff us on. Although such programs and packages are invariably 
reported as "successful," each faced anew the problems of entry, resistance, 
and linkage training with its respective audiences. Moreover, even having 
solved thes 2 problems for themselves, they lj not contribute very much 
to our general knowledge on linkage problems in education. Their techniques 
for dealing with these problems are not readily genera 1 i zab 1 e to other 
audiences o~ to the same audience under different conditions because 
the techniqjes of entry, linkage training, etc. have not been clearly 
d i f ferent I a ted from the innovation itself. 

Also, as these examples illustrate, much of the existing research 
had as its jrimary audience that group of practitioners who are most 
directly in/olved with the consumer (student, patient, etc.). These 
people are -arely in a position to assume the role of knowledge linkers 
to other practitioners. They may or may not have the administrative 
authority act as a linker or change agent in their system, but If 
they are di'ectly involved with the consumer they will have little time 
or energy t j devote to linking activities after coping with the more 
sa 1 i ent--an 1 urgen t--da i 1 y problems in their own consumer system. 

One at:empt to overcome these limitations and to establish linking 
functions aid roles as a permanent aspect of a school system was reported 
by Shcevitz and Barr (1968) In A Training Program for Research Utilizers: 
Philosophy, Goals and Methods . Their simultaneous "microaction" and 
"macroact io i" research directed training in change processes at class- 
room teache-s and principals and at people who had cross-building 
responsibilities within the school system. However, a lack of user 
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sophistication and an unfortunate 1 ac ! ; of involvement on the part oi 
the participants motivated the research team to turn from general 
issues of change processes to the solution, through change, of specific, 
existing prcblems in the system. Thus, the future linkage potential of 
these two gioups remains unexamined. 

Another important contribution to our early planning for this 
orojoct was the work of the Communication Program of the Far West 
La bo r a to ry lor Educational Re search and Dcvel op me nt directed by Dr, 

Paul Hood. We were especially impressed by the systematic development 
and evaluation process employed by that program in the evolution of 
educational products, and we made a conscious effort to adapt their 
approach in our own planning. 

On the whole, past research seemed to say exceedingly little about 
the effectiveness of specialized communications of the type envisaged 
in this pro ect. On the other hand, there was some reason to believe 
f rom nume rous studies and observations of know leoge linking roles In 
various other fields that the development of viable know! edge - 1 i nk i ng 
roles in education would be significantly aided by the simultaneous 
development of training programs, handy reference tools, and other 
software supports at least on a par wi th those now possessed by the 
county extension agent in agriculture. They also suggested the need 
for a development strategy which included features such as: 

(1) participation by the audience in product planning, 

(2) systematic evaluation, and 

(3) p anned diffusion including user training and follow-up. 

With these Ideas In mind the Michigan team developed a proposal 
to USOE for a manual incorporating features (l) and (2) with the 
expectation that feature (3) would be added at a later date if the 
early work was successful. 

2. Literature Review and Annotated Bibliography 

After : unding, the project staff began by making a thorough search 
for major works on change in education, updating the search effort of 
two years earlier which had led to the comprehensive literature review. 
This time, lowever, we were especially on the look-out for literature 
on change wiich was practitioner-oriented and in which derivations of 
implication! for practice were spelled out. 

From this literature review the staff* developed the first product 
of the project, an annotated bibliography of "Major Works on Change in 
Education" with a detailed subject index. The subject index was later 
valuable as a key to specific points and quotations which we wanted to 
include in the "Guide." It was also antici pa ted that this bibliography 



*Havelock laid out the overall plan and took part in editing and screening 
while the annotations and indices were developed by Huber and Zimmerman, 
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would be a useful append 1 x for the "Guide," itself, and for that 
reason we used the following criteria for choosing works to be 
c i t e d : 

(1) jenerai coverage of a range of topics relevant to 
educational change. 

(2) In book form. 

t3) ■’ublished and available in education libraries, 

Dook stores, or by ordering from indicated sources. 

fo r tie mos t part we excluded empirical studies and reports on 
specific rssearch projects unless they covered a range of relevant 
topics, offered both research findings and implications for practice, 
and could :>e obtained as separate monographs. 

Copies of the bibliography were printed and distributed both 
by the Unl/ersity of Michigan's Institute for Social Research and by 
the Northwest Regional Educational Laboratory.* Included was a 
sheet ent i : led "feedback to authors" which asked readers to voluntarily 
indicate how they had used the bibliography and how useful it had heen. 
Although this device induced only a trickle of responses (they are 
still coming In) there seameh to be a generally favorable response. 

3. Chocs ng a Structure for the "Guide" 

There were several alternatives available to us in structuring 
the Guide," and because of the potential importance for later utility 
and acceptance by practitioners, we were anxious to explore a number 
of them be ore arriving at any conclusions. At least six pos s i b i 1 i t i es 
presented ihemselves; 

(l) An encyclopaedic compe ndium of facts about change process, 
written 'n a simple style with practical implications, 
spelled out and arranged as alphabetical entries of any 
length from a short paragraph to 2 or 3 pages, thoroughly 
cross indexed. 

/ ■‘ros : relatively easy and straight forward to create, 

a good reference for specific user needs, maximum 
user selectivity allowed. 

Cons; expensive to produce if done well (it would be very 

large) , hard to disseminate, very low user involvement 
(impossible to read cover-to-cover) , difficult to 
use in a training program or in a course. 



n neithei case were f ede i'a 1 funds from this project used for dissemination. 
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(2) \ systems analytic framework such as S tuf f 1 ebeam 1 s 

Context - i nput~ Process “Product 1 ' ( 1 g 7 q ) , 

,'vos: would allow a systematic coverage of most topics 
in a logical orde . This would make the book 
most useful to policy and program planners especially 
if they had engineering backgrounds. Increasing 
numbers of educators are becoming familiar with 
this approach to conceptualizing and ordering the 
facts about complex topics. 

2ons: may not do justice to some of th? social and 

psychological realities which the change agent 
must contend with. Moreover it is still foreign 
territory to many educators and enemy territory 
to some. 

(3) \ communication model approach (i.e,, "Who says or does 

what to whom by what channel to what effect.") such 

is used by Hovland (1 954) , Rogers (I 962 T and Havelock 

( 1969 ) in his comprehensive literature review. 

■voa : also allows systematic and comprehensive coverage 

including the human and social variables. Further- 
more since the prime sources are already organized 
this way the task of retrieval would be greatly 
s i mp 1 i f i ed . 

Pons : has tended to be a researcher's or theorist model 
rather than a practitioner's. 

(4) \ casebook with annotations for each case referencing the 

"esearch literature. 

Pros : this would involve the reader and would be 

especially helpful to those who find themselves 
in similar situations to one or more of the cases. 

It would also be an extremely helpful adjunct 
to t ra i n 1 ng . 

7ona ; it would be very difficult to teach much substance 
of the research or theory of change In this manner 
and it would be very difficult to compose in the first 
place. There is also a paucity of good, clearly 
written case materials showing a range of the "do's" 
and "don'ts" of innovation management. 



( 5 ) Tn anthology of the best writings available. 




Pros : it would be relatively easy to construct such a 
document. The bibliography previously described 
lists several such works and a selection of the 
choicest pieces from each would be a simple matter. 
We could also guarantee that the writing would be 
first class, the coverage broad; and the points 
of view varied. 

11 



i r. would be difficult to present, n coherent, over - 
view or systematic topic coverage. Most of what, 
i s wr i t ten , even it it is very we 11 writ ten , i s 
not prac t i t i one r -o r ien ted and does not go for in 
spelling out the "how to's." 



(■') 



f' rob 1 em solving stages; Uiis is the approach 
l.ippitt, Watson and West ley (1358). 



used by 



/TV,:*; from our reading of the limited research 1 iteroture 
on the change agent, this approach seems closest to 
the way he organizes his life and work. it al lows 
systematic and logical ly ordered topic coverage and 
is especially suited to the "how to" style of 
presentation. It is also fairly involving and can 
be presented in parallel with actual case materials. 

It is also handy as a basis for simulations. 

’.w?. 1 there is little agreement among experts on ei ther the 
numbering or the ordering of such "stages"; moreover 
it may t ore difficult in this approach to pick up 
the change agent "where he's at." This frame work might 
be seen by some s too rigid and arbitrary to apply 
to the myriad of situations the change agent might 
find himself in. 

After some discussions wi th other CRUSK staff experienced as change 
agents and change agent trainers ( e . g . , Ronald Lippi tt, Robert Fox, 

Mark Ches 1 2 r , an cl Lucille Scha i b 1 e) and some intensive field intervi ews 
with educational change agents In Michigan (in the state department, at 
the University, and in three school districts), two tacts became evident; 
(a) that tie problem solver and the casebook approaches were both the 
most user-priented and (b) that it is very difficult to elicit meaningful 
reactions to the idea of a product when the reactors don't have a model 
of the "real thing" in front of them. 

Weighing these alternatives and facts, we chose the problem solver 
stages approach as our primary structure for developing a first prototype 
with the added notion that various appendices (such as the annotated 
b i b 1 i og rap iy ) and a subject index could enhance its value as a reference 
work, and that a series of case studies would increase and enhance its 
value as a readable and involving book. 

4. Exploratory Field Interviews 

The exploratory field interviews were especially important in giving 
us a picture of the "life space" of the people who are now operating 
as educational change agents. It was obvious that most of these people 
are not theorists or even grand strategists, that what they know about 
the change process is not very systematically organized and only loosely 
articulated, that they think in terms of specific projects on which they 
are working, and that their thinking runs in a kind of a chronological 
order as they talk about their work. It was evident that if we were 



to be truly collaborative we would first have to give these change 
agents a chance to tel 1 their war stories in gory detai I and we would 
have to listen carefully to show them how their experiences and the. 
research on the change process mulched up. 

Originally a conference had been planned to attract twenty or 
more educators representing change agents in at least four categories: 

(a) State Department of Education personnel who are encaged 
in disseminating new knowledge to school systems. 

(b) Directors of knowledge utilization and demonstration 
projects under Title III of the Elementary and 
Secondary Education Act. 

(c) Dissemination staff members from the Regional 
Educational Laboratories. 

(d) Professors in schools of education. 

However because o f our budget constraints and the increasingly 
evident need to work in depth with those who we contacted, we decided 
to limit the first conference to five articulate and representative 
change agents who would be willing and able to (a) read our materials 
critically and thoroughly, and (b) provide us with descriptions of 
their W(..rk which could be developed into cases for inclusion in the 
"Guide." 

5- The Knowledge Linkers Workshop 

During the fall of 1968 and the early winter of 1969, the project 
staff worked to develop a first prototype of the "Guide" based on 
the problem solving structure in preparation for the first evaluation 
by the change agents and a representative of the USOE (Mr, Richard 
E 1 mendorf ) . By February 15, each participant was mailed a rudimentary 
draft version including drafts of the introduction. Chapter I "Establishing 
the Knowledge Linker Role," Chapter 2 "Diagnosing the Problem in the Client 
System," Chapter 3 or: "Retrieving Relevant Knowledge," an appendix to 
Chapter 3 on available information resources, Chapter A "Selecting the 
Innovation, " and the annotated bibliography. 

The conference was convened on March 15, 1969. By prior arrange- 
ment each participant began by relating a case of attempted innovation 
from his uork experience. The case could be either successful or 
unsuccessful but in either case it should be the one he knew most about 
and the one that seemed to him to illustrate the most about the change 
process. After each presentation the project staff would question the 
presenter and suggest how his narrative could be fitted to a problem 
solving stages model of change. 



Part of the afternoon session was reserved for comments and reactions 
to the drafts of "Prototype #1." The introduction and the overall plan 
for the "Guide" were received favorably as were the two appendices, but 
all the participants found the writing style difficult and the layout of 
chapters cumbersome and rather overwhelming In detail. It was clear that 
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The "Guide" as it was developed during this phase of the project 
had six components: 

( 1 ) 



(2) 

(3) 

(4) 

(5) 

( 6 ) 

The fourth part (strategies) was derived from a CRU5K working 
paper by Havelock entitled "Innovations in Education: Strategies 
and Tactics." This listing was added as a compromise with the encyclo- 
paedic approach mentioned on r 1 i e r . 

As finally assembled, prototype #2, represented a combination of 
approaches intended to appeal to users with a variety of information 
acquisition habits. The first three parts could be read in succession; 
the last three parts could be used for a variety of reference purposes. 

A reader could also b rouse or skim with the aid of charts, a clear 
outline and headings and many quotes from the leading authors in the 
field. 

We were concerned, of course, that all these elements might 
represent too much for a manual of this kind but it did provide readers 
with many alternatives, and with a thorough evaluation planned, we 
felt that it would be best to let readers decide what should stay and 
wha t s hou 1 <1 go . 

7. Review by a Rational Cross-Section of Educators in Typical Change 

Agent Roles 

By the fall of 1969 we felt we had a product worthy of field 
evaluation. As called for in the proposal, reactions were solicited 
from four groups of educators thought to be typical of those now 
operating as "change agents" within the U.S. educational complex. The 
sample chosen was not intended to be representative of the nation's 
educational linkers in any strict statistical sense, nor were the four 
populations from which they were drawn exhaustive of possible linking 
role positions in the national educational establishment. However, each 
of the populations chosen had certain distinctive features which made 
them sigrlficant audiences against whose judgment the utility of the 



The introduction which exp 1 a i ned the purpose of the "Guide," 
suggested three alternative role models for the change agent 
and a brief analysis of six process stages ("building a 



relationship," "diagnosis," "retrieving resources," "choosing 
solutions," "gaining acceptance," and "stabilization and 
sel f “ renewal . " 

The four case studies. 

The text of six chapters, each representing a "stage." 

An alphabetical listing of specific "strategies" of 
change . 

An index of information sources in education untended as 
a supplement to stage 3). 



The annotated bibliography 
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manual should be measured. The significance of each group is specified 
briefly below: 



(1) State Department Personnel : 

Every state employs a number of professional educators 
(ranging from about 10 in the smallest states to about 200 
in Nev* York and California) as consultants, coordinators, and 
disseminators in various specific subject matter areas typically 
under major divisions identified as "administrative services," 
"instruction," and "vocational education." Whether or not such 
professional staff serve as knowledge linkers is not entirely 
clear. However, such persons are strategically located and 
formally charged with duties wh i c.i bring them Into frequent 
contact with practitioners (administrators, teachers, and 
other?) under circumstances where they may be seen as know- 
ledge linkers, 

Etate Department personnel are also significant as a 
potential audience because of the probable increased reliance 
upon the states for the administration of federal dissemination 
programs over the next few years. 



(2) E SEA Title III Directors: 



Ihis title provides funding for locally originated 
projects to diffuse innovations and facilitate the innova- 
tive f recess at the school system level. With fiscal year, 

1366, the federal government started funding 1,000 such 
projects across the country. Directors of such projects are 
change agents or administrators of innovation activities more 
or less by definition. Hence, they represent a large and 
rapid'y growing new audience for knowledge about the utiliza- 
tion process. Study of this audience and its reactions to 
the m;nual might give some indication of the relative merits 
of i n; ta 1 1 i ng and supporting knowledge linkers on the local 
schoo' system level in contrast to state, regional or federal 
loci. An estimated 1,500 individuals belonged to this popula- 
tion fit the time the project began. 

( 3 ) Regional Educational Laboratory Dissemination Staff: 

''he RE l 1 s were established with the specific mission of 
development and d i.ssemi nat ion of educational innovations. 
Although they varied greatly in size and emphasis, the 20 
REL's then in existence represented an Important emerg i ng force 
in the educational establishment. They were staffed by young, 
eager and often highly skilled professionals dedicated to 
educational changa. Thus, although the number of individual 
diffu: ion personnel (including those involved in demonstration 
and fold consultation activities) was small (approximately 200 
Individuals at that time) it was proportionally large within the 
REL's. In addition the REL's deserve close watching as potential 
loci lor a vastly expanded federal effort in which an equivalent 
O 
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of thj present diffusion network in agriculture (the Coopera- 
tive Extension Service) would be installed in the field of 
educa t i on , 

(k) ’rofessors of Education: 

There are an estimated 50,000 professors of education 
teaching in the 1,500 degree-conferring institutions of higher 
learning in the United States. Although it is presumed that 
few f “om this group would identify themselves as "knowledge 
linke-s" or "change agents," they rep _,ent the largest clearly 
identifiable poo 1 from which such persons are likely to emerge. 

In selecting a sample from this group for evaluating the manual, 
we we *e guided by such additional criteria as: some amount of 
extension teaching, involvement in consulting activities off- 
campus, and membership or training experiences with such groups 
as th * National Training Laboratories of NEA. 

In accordance with the plan set out In the original proposal 
prospective respondents were chosen at random from available lists 
and were s»nt a letter and a brief form explaining the project, 
asking for them to spell out their current role and soliciting their 
consent to be reviewers of the manual in exchange for receiving a 
complimentary copy of the final product. 

The response to the comm! tment request i tter was very encouraging 
(151 cut O’ 200 or 75.51 accepted). Of L h e s 1 1 5 later returned completed 

review forms (7S.S %) . 

Althojgh the detailed results of this review process are presented 
in Section II of this report, their import can be s umma r i zed briefly. 

The review process was successful on three counts: 

(1) i i. elicited a high rate of return. 

( 2 ) Reactions to the "Guide" as a whole and to all major 
sections was overwhelmingly positive, 

(3) The reviewers provided us with extensive and detailed 
information for the development of a third and signifi- 
cantly improved version (prototype #3), 

8 . Creation of Prototype # 3 

With additional support from the U.S. Office of Education we were 
able to use the feedback from the reviews to formulate another revision 
of the "Guide" in the winter of 1970. The principal changes made 
we re as foil ows : 

(l) Complete rewrite (for about the tenth time) of the 
i n 1 . roduct i on . 
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(2) Complete recomposition an ewrite of Stage 
('V.cqu i r i ng Resources"). 

(3) Introductions and "editorials" on each case study. 

(is) Updating the appendix of information sources 

(the obsolescence rate for this index is extremely 
high) . 

(5) Minor changes in the other "stages." 

(6) The inclusion of many more references to the case 
studies in the right hand column of the text. 

Each of these revisions was based directly on feedback from 
rev i ews , 

9 . Dissemi nation and Utilization of Prototype #3 

This third prototype version was considered sufficiently polished 
tc merit limited distribution and utilization in some training workshops 
and conferences. Under a developmental copyright, the Institute printed 
and paper-bo jnd 2,000 copies, recouping pointing costs with a $ 3 - 00 
charge on each copy. 1 ' 

In addition to individual users, the "Guide" became the basis 
for several in-service training workshops, conferences, and graduate 
seminars among which were the following: 

(1) The "Guide" formed the basis of a training institute for 
vocational education information specialists and program 
administrators held at Pittsburgh, Pennsylvania in May 
of 1970.** At this event, participants divided into 

fcur groups to simulate the development of a change project 
using each of the six stages. 

( 2 ) The "Guide" was one of several background documents 
sippl led to the Michigan conference on Educational 
Change Agent Training (CECAT , see Part C below for 
f l 1 ler dl scussion) . 



*No federal funds used for this purpose. 



*0ne of seven institutes supported under a grant from the US0E to a consortium 
coordinated by forth Carolina State University entitled "National In-Service 
training Multiple institutes for Vocational and Related Personnel in Rural 
Areas,* 1 The workshop In question was organized and directed by Dr. Douglas C. 
Towne of the University of Tennessee, now at the Northwest Regional Educational 
Laboratory, Portland, Oregon. The other workshops all received material s. from 
the "Guide" (Introduction and Case Studies) but specific training activities 
were not based on them. 
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t was a key document in a training program sponsored 
hy the Department or Health, Education, and Welfare, 
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(4) n the summer of 1970 the "Guide" was used in conjunction 
with two pilot programs to train state agency linkage 
agents (Project SPREAD at Denver, Colorado and the Pilot 
State Program sponsored by the National Center for 
Educational Communication (NCEC) at the University of 

ili ssou r i ) . 

(5) n the winter and spring of 1971 the "Guide" was used 

as the basis of graduate seminars at Michigan and at the 
University of Sussex in England, in these seminars 
graduate students worked on educational chan projects 
which were analyzed systematically according „o the six 
stages . 

(6) "he Special Interest Group on Research Utilization of 

he American Educational Research Association held a 
:h ree day workshop at the Educational Testing Service, 
Princeton, New Jersey in February of 1971 at which the 
"Guide" was one of the basic documents, 

(7) n June of 1971, the University of Wisconsin at Milwaukee 
held a 2 day in-service training workshop at which the 
"Guide" was the core document, in this seminar, participants 
clustered into eight groups. Two groups focussed on each 

of the four case studies, listing what should have and could 
have been done at each stage. 

The above represents only a partial listing of the uses of the 
"Guide" to date that have come to the attention of the author. They 
suggest the range of uses of the "Guide" and its potential utility in 
the future as a field manual on change and as a basis for pre-service 
and in-service training of resource linkers and change agents in a 
variety of educational areas, roles, and levels. 



10. Further Revisions and Additions Under USOE Contract 



Although none were funded under this contract, most of Lhe dissemination 
events 1 i s :ed above were evaluated and provided feedback of potential 
relevance 'or redevelopment of the "Guide" at some future date. Most of 
this feedback was extremely positive suggesting that the core document 
served its purpose more than adequately. However, there were certain 
changes and additions that might make it even more powerful and more 
relevant for a wider audience. Therefore in a contract supplement the 
USOE provided additional funds for the development of: 

(1) bhecklist summaries of major points In each chapter. 



-; 3 - 



(2) introductory section for administrators end at least 

one other specialized audience. 

and ( 3 1 \ new section on establishing the rnl e of change agent- 

< now ledge linker. 

Each j f these additions was developed and written in the summer of 
IS?! and all are included in this report, although none have been field 
tested for effectiveness. 

The ciecklists, which are contained in "Attachment #2" below, 
still require and deserve considerable revision and evaluation. Ideally 
they shou 1 j follow a development cycle parallel to the "Guigt;" itself. 

it wa 5 decided that special Introductions should be brief and fairly 
broadly targetted or else they would throw off our original change agent 
audience. The second introductory statement applies to "inside agents 
working fram below" which we found to be the largest class of users 
and potential change agents on the educational scene, i.e., students and 
teachers 20 want to change their own school. These sections are incor- 
porated in the "introduction" to the copy of the "Guide" presented in 
A t tachmen t H 1 . 



no t 

section 
provide this 
(At tachmen t 
IV - 1 , 2 , 3 
instal lation 
and spec i f i c 



n ;w piece on the problem of establishing the role of linker has 
incorporated in the "Guide" as such (although the role description 
has bee n ex pa nded and revised) . Ra then it s coined appropriate to 
material as part of the manual on training program design 
where it is incorporated as elements of Part IV, especial 1 
and 5. Considerations of role def i n 1 1 i on, deve lopmen t, and 
are thoroughly explored throughout the training design manual 
alternatives are provided in Parts V and VI. 



y 



’ reduction and Publication of a Final Version 



After two and one-half years of development and field evaluation, 
the "Guide 1 has been shaped into a potentially powerful tool for 
educational practice improvement. However, a good deal remains to 
be done to make it widely disseminable and usable through the remainder 
of this decade. 



The ajthor has immediate plans to revise and expand several parts 
including the introduction, Stage I, Stage VI and all the appendices. 

In particular Appendix B has proven extremely vulnerable to obsolescence 
and must b* thoroughly overhauled. All these changes will be made by 
the author’’ and they will lead to the publication of the ''Guide" in the 
spring of 1972, probably by Educational Technology Publications, Inc. 



“This will be done without the use of federal funds from this contract. 
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The Evol ut: i on of C hange Agent Trai ning Strategies and a Ma n ual ro r 
Chang e Agern ; Training Des i g n 

1, Bac '-‘ground: The Need for Something Beyond the Guide 

The original proposal for this project was focussed exclusively 
on the deve opment of a "Guide" to the process of knowledge utilization 
(in early d ‘aft titled "The Knowledge Linker's Handbook"). The 
"Guide" was to be targetted to a particular educational audience, 
those concerned with utilizing knowledge to introduce practice improve- 
ments at al levels and in all types of educational situations. However, 
from the beginning there was a problem in identifying who these people 
we re by tit' 1 © and position. Up to now no one in education has carried 
the title o" "change agent" or "resource linker," "utilization specialist" 
or "knowledge broker." Vet once the development cycle began and we started 
identifying individuals, 1 n terv i ew 1 ng them, and getting their Inputs on 
the emerging "Guide," it became evident that, while such people do exist, 
they are (a in very short supply, (b) know very little of the literature 
on change, and (c) fly by the seat of their pants in developing change 
strategies. 

The "Guide" would be a in* 1 p pr ov i de<l the right people were aware 
of it, were motivated to read it, and had enough initiative to find 
ways of using it in their work. These were ail big "ifs." Clearly 
something more substantial and intensive was needed if we were to move 
toward a really lasting, coherent, and professional concept of resource 
1 Inker. 

As wi tn the development of the "Guide," itself, we decided to move 
forward in 3 collaborative and systematic way, this time involving the 
key national leaders who had had a hand in the training of various types 
of eduratioial change agents or had a hand In administering organizations 
and programs in which such individuals would be working (e.g, State 
education agency staff). 

The i d 2 a of a training program design as the appropriate next step 
in our program had roots in other events of the previous two years that 
a re wo rth not i ng : 

(1) Tie need for the design of some sort of nation-wide program 
t d diffuse current knowledge on utilization and planned 
innovation was discussed at length during the review conference 
of leading utilization scholars in Ann Arbor in February, 1968 
(that meeting was sponsored by the Literature Review Project). 

At that time, Everett Rogers described the experience of the 
National Project for Agricultural Communications (NPAC) which 
was launched in the mid-fifties as a program to diffuse current 
knowledge about communication of innovations to agricultural 
cnange agents in all the states. There was consensus among 
tie group that a similar program was needed now in education. 

Tile same Idea was proposed again to the Special Interest Group 
on Research Utilization of AERA at the annual meeting in Los 
Angeles in February, 1969, and strongly endorsed by most of 
those present. 



(2) 

O 
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(3) Our experience in April, 1969, at the mi n i -conference 

o( educational change agents to discuss the emerging hand- 
be ok (see B-5 above) strongly indicated the need for soma 
sc rt of training workshop as a necessary accompaniment to any 
w i i t ten materials. .he Da r- 1 i ci pants at this meeting were 
orly able to identify themselves with the materials after 
they had had a chance to discuss the "agent" role concept 
i i the context of their own work and to compare their 
experiences with others engaged in similar activities. 

For these reasons a proposal to extend the project to include a 
conference <o develop training program specifications was submitted and 
approved by the UBQE; subsequently a second supplement was requested 
expanding on these ideas and calling for more extensive conference 
follow-up ( n addition to "Guide" additions described earlier). 

2. Conference Planning 

As a f rst step in developing this part of the project a planning 
and steering committee was formed consisting of: 

Ronald G. Havelock, Project Director 

Henry M. Briekell of the institute for Educational Development 

Charles C. Jung of the Northwest Regional Educational Laboratory 

Thomas C. Clemens of the U.S. Office of Education 

Th ' s gj'oup represented a range of backgrounds and points of view 
with a common central concern for the training of specialists in resource 
u t M i za t i on , 

The committee had these concerns: (a) to design an event that would 
be Involving, informative, and productive: i . e . , we had to attract the 
very best psople in the field, we had to teach them what we had in mind 
as "resource linking change agentry," and v.e had to get them to work 
together to produce some training designs. (b) to choose a list of 
potential participants and a procedure for recruiting them. 

To speak to the first concern, It appeared that the conference, itself, 
should be designed to have three phases: (1) input (to familiarize or 

remind participants of existing state-of-the-art knowledge about 
change p roc ass) , (2) discussion (to analyze the problem of training and 
to derive Inpllcations from research literature relevant to change 
agent training), and (3) output (to work together in teams to put 
together actual training designs based on (l) and (2)). 

To reinforce the input phase it was decided to provide all conferees 
with advance written materials and to ask for extensive prior reading 
and thinking on the content represented in these materials. By this 
means, hopefully, all participants would arrive with some common knowledge 
in their heads, some shared expectations, and a specific expectation that 
they could and would contr ? bute to the proceedings. 



C h oo ling and recruiting par ticipants was also a crucial task. 

We had U have people who (a) represented the highest levels of 
sophistication and understanding of change processes from a variety 
of perspectives,. (b) had long experience and know-how in thenar t and 
science of t ra i n i ng , per se , (c) understood the complexities of the 
eouca 1 1 on< 1 1 settings in which trainees would be working, and (d) had 
the national recognition and respect as leaders and experts to give 
the conference and its outputs maximum visibility. 

To meet these objectives at least seven constituencies had to 
be represented in some degree: 

(1) prominent researchers on educational innovation process, 

(2) U.S, Office of Education: research training, planning, 
d i ssem i nat ion , 

(3) state education agency officials, 

(*0 school of education deans, 

'5) superintendents or program directors f n r school 
districts or exemplary programs 

(6) private enterprise, publishers, etc,, 

(7) Regional Educational Laboratory and Rr.D Center 
directors and staff especially concerned with 
dissemination and change, 

Undei these seven headings the committee drew up a list of over 
150 names. From this list a smaller number (8-10 in each category) were 
selected ;s the persons to be reached in the first wave of invitations, 

, , Because of the prominence and expertise of the chosen group, it was 

decided tl- at further i ndueement i n th? form of travel and living costs 
s Quid be offered, A grant of $2,000 was provided by the Center for 
Research on the Utilization of Scientific Knowledge from its Kellogg 
Found a 1 1 ot grant to help defray these additional costs, 

3. /i 'commitment 



Six fey experts were contacted by phone approximately five months 
before the tentative date set for the conference. Because the participa- 

h° n iaV T P e , rS 2" S W3S d6emed esser| t < a Ij it was felt that their schedui 
should be checked first and commitments obtained. The fact of their 

agreement to participate would also be a draw to some of the others we 
would contact later. 



letter of invitation was composed explaining the nature of the 
:ncc , objectives, time, place, etc. This letter was very care- 
u y prepared, checked out with steering committee members and several 
others, « and rewritten several times. A copy of the letter is reproduce 
on the following page. 



’‘Arthur Chi eke ring was particularly helpful 
content of this letter. 



as an advisor on the tone and 
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I would like to Invite you to join in a three day collaborative effort to 
pur together guidelines for the training of educational change agents The 
nee ting will be held at High/Scope in Clinton, Michigan on May 25=27. 1970. We 
will address ourselves principally to three questions: 

]. "What do we now know about the management of educational innovation?" 

2, "How can this knowledge be effectively incorporated in the pre-service ^ 
and in-service training of administrators and educational consultants?" 

3, "How can we initiate programs to provide this type of training for the 
growing nunner of educators across the nation who need It and are 

ask i ng for I t?" 

By bringing together a group of thirty recognized national leaders i n ^ 
administration, training, research and practice, I believe it will be possible 
to set down some guidelines and program alternatives which are truly creative 
and responsive to the need. Our work will result in a published document which 
should have considerable impact. i he re will oe an immediate influence on 
training programs now in the works and a long range influence in guiding future 
program planning in this area. 

The sessions will be designed to allow maximum contributions from each of 
us and a maximum opportunity to exchange ideas. Thanks to support from the 
U.S. Office of Education and the Kellogg Foundation we will be able to pay 
expenses and travel for all participants. Additional details are provided on 
the attached sheets. If you have any other questions on any of this, call me 
collect at (BIS) 764-2560. Please let me know by phone or return mail if you 
think you will be able to join us. 

Yours sincerely. 



RGH * rw 



Ronald u . Havelock 
Cha i rman 




The basic information on plans for the conference was spelled out in 

a 3"page attachment which is partially reproduced below. 

1 1 

PLANNING FOR EDUCATIONAL CHANGE AGENT TRAINING 
A Worki n g Confer ence 
H i gh/Scope , Clinton, Michigan 
May 25“27 , 1970 

1 ' Obj ect i ve : To pool what we know about the management of educational 
innovation and to generate a set of guidelines for the 
training of administrators and consultants who have the 
responsibility for directing or advising innovation 
programs and projects at various levels. We want to 
think through the whole question of what is needed to train 
people to be more affective change agents. Additionally, 
we will be concerned with how we can plan a national program 
or programs in this area. 

' Why the Con : erence is Needed and Why Now . 

1. P'evious reports calling for more change agents and d i ssemi naf nrj 
hive received considerable notice. A training design is the key 
implementation step for establishing such roles in large numbers. 

2. Ws are now in a better position to formulate programs than we 
have ever been before because of the major reviews ar.j summaries 
oF existing knowledge on this subject that have appeared in the 

1 as t few months . 

3. Tie federal administration is now searching for new approaches 
to educational reform, and officials in the U.5. Office of 
Education have indicated a special interest in the problem of 
diffusion and utilization of educational innovations. 

' Your Role ; You will be a contributor and resource person from your 

experience and from the reading you have done. There are 
no set roles, no papers read; we will, however, furnish a 
number of background materials which should be read prior to 
your arrival. These will help us get into the substance of 
the meeting very quickly. 

Meeting Structure : We will subdivide into work i ng groups of about 8 for 

most of the time. The meeting will be carefully 
planned so that we can wind up with a high quality 
product and at the same time so that each man will 
feel he is both learning and contributing in relevant 
ways . 

This eonrerence, itself, should be a model for working 
conferences of the future. To that end, we are going 
to put together a number of ideas about meeting structure 
and participation that have been used successfully in 
the recent past and we are going to experiment with 
some new approaches as well. 
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"How V/ ill the ihree Days be Used: 



Day ft 

I mpl i oat i ons of 
Resea 'ch and Theory 



We will spend the first day reviewing current 
research and theory on innovation, planned 
change and knowledge utilization in an effort 
to identify the essential facts that a change 
agent or an administrator with change "spent 
responsibilities must know. 



Day #.l 

A 1 te rna t i ves for 
I dea 1 Tra i n i ng 
P rog rams 



On the second day, we will consider what we 
know about training and the manpower needs 
and resources both for trainers and trainees. 
By the end of this second day we should have 
identified a series of options or components 
for the ideal training program, pre-service 
and i n - s e rv i ce . 



Day ft J 

I mpl enentat i on 



On the final day, we will consider implementation 
possibilities and strategies. How to organize 
and fund a training program that will have 
national impact will be a major concern at 
this point. How can we get maximum utilization 
of what we have generated in these three days. 



"Product: After the meeting, the training guidelines generated by the group 

wi 1 1 be written up, edited as a report for the U.S. Office of 
education and for publication as a monograph. We are also 
planning to Invite conferees to write brief position papers on 
certain critical issues as these may emerge from our discussions, 
"‘hese papers will then be edited and published as part of the 
•eport. Some additional funds are available for reimbursement 
o paper contributors." 



The invitational letter and this advance descriptive material proved 
to be extremely effective as 56 of the original list of 75 invitees 
accepted outright! Of the remainder most called or sent courteous notes 
explaining their unavailability and regret at not being able to attend. 
This response left us with an embarrassment of riches. Since we had more 
acceptances than anticipated (a maximum of 501 positive response was 
expected) we had two problems, first to pay for the additional travel 
costs,* and second to design a meeting which could involve more attendees. 

It was also pleasing to no t e that' we had acceptances from people in 
each of the, seven categories although as It later turned out, two chief 
state school officers (Massachusetts and Colorado) who had accepted were 
unable to attend. Altogether 50 of the 57 persons who accepted invitations 
pa rt I c i pa tod In the conference. 



*Again CRU5K heped us with some additional support from the Kellogg grant. 
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On May 25? 1970 the "Conference on Educational Change Agent Training" 
(CECAT) began on schedule at a secluded conference center in a country 
setting 5 ' a 1 : Clinton in southeastern lower Michigan. Most participants 
arrived Sunday evening, May 2k, for dinner and had an opportunity to 
get acquainted or reacqua i n ced informally before the actual work of 
the meeting began. 

Each participant had previously been mailed a number of materials 
including a paper by Goodwin Watson summarizing the research literature 
on research utilization,** Planning for innovation by Havelock, et a), 
a 500 page work presenting a comprehensive summary of the literature on 
planned change, dissemination, and utilization as of 1969, the "Guide" 
(prototype If 3) and another pract i t i oner-or i ented manual on the change 
process prepared by Everett Rogers and Lynn Svenning for "Operation PEP," 
a Title IN project based in the San Mateo, California school district. 

! n addition each participant had been provided with an extensive 
reaction form covering the major findings reported in these readings. 

The form asked for their theoretical orientation, their judgment of the 
importance of various topics and their choice of a topic on which they 
could serve: as a special informant and resource person to others at the 
conference. Nearly all participants had faithfully comp leted this form 
and returned it to us prior to May 20th so that we were able to collate 
responses end provide every member w i t. h a col lective profi le of knowledge 
levels, attitudes, and interests of those attending the meeting. 

Charles Jung also prepared a list of generalizations on the training 
process derived from research findings. We hoped that participants would 
peruse these two documents fairly carefully to get a feel for what would 
be discussed the first two days. 

After a brief orientation session on Monday morning the participants 
divided Into six groups of about 8 members each; these groups were pre- 
selected to be more or less homogeneous on the basis of theoretical 
orientation and topic interest. They were each provided with a recording 
secretary end were asked to appoint a chairman to guide the discussion, to 
keep time so that each had a chance to make a presentation around one of 
the generalizations and to post the major points arising from the discussion 
for sharinc with the other groups in the late afte r noon 



^Actually, because of the number of participants and the small number of 
private rooms, many had to double and triple up. This caused considerable 
discomfort to E-ome, The site chosen proved to be a significantly negative 
feature of the conference, 

**P repared for an NIMH contract to Edward Glaser and the Human interaction 
Research Institute to prepare a manual on the use of research results in 
mental hea 1 th , 
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The newsprint summaries of each group's discussion of the day 
were posted In the large meeting room and participants were encouraged 
to "walk around" to inspect and consider the points made by other 
g roups . 



On the evening of the first day, these same subgroups met once 
more, this time to consider the several additional topic items that 
participants had added to the list on the pre-conference feedback form. 
These "hot issues" discussions were undoubtedly a highlight of the 
conference for many participants as there was an opportunity to explore 
issues of great personal concern and currency with a distinguished 
group of colleagues. Some of these sessions continued well into the 
late evening hours. 



The second day began with a panel discussion of training "experts" 
on issues particularly germane to training per se, Kenneth Benne , Matthew 
Miles, Lucille Schaible, Irving Millgate, Ronald Lippi 1 1 , Floyd Mann, and 
Max Goodson each made a brief presentation on training issues followed by 
a general discussion including all participants. 

Following this general meeting a new set of subgroups was formed 
with each of the panel members as chairman of a group. The groups were 
intended to discuss and post key training issues using as resources 

(1) the Jung list of gen 'alizations on training, and (2) the panel 
discussion. 

It appeared in retrospect that the device of a "panel" was somewhat 
divisive since many other participants had expertise in this area and 
may have resented the apparent elevation of a few. Although the 
conference chairman (Jung) and the organizer (Havelock) thought the panel 
was very stimulating, It was not rated highly by most participants. 

On Tuesday afternoon Jung and Havelock explained the nature of 
the task for the last day, to work in teams to develop training designs 
and in the process speak to seven questions: 

"(1) Define the change role, provide a rationale and state 
limiting assumptions, 

(2) Minimal preconditions for selection/training of trainers 
end trainees, 

(3) Maximal outputs from training. 

,, .attitude and value 
. . . knowl edge 
...skills 
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CO Ways to provide required training (e.g. , timing, scheduling, 
setting, types of materials, types of experiences). 

(5) How to set role in an institutional context, 

(6) Criteria for success in the role. 

(7) Evaluation process," 
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Following this or i enlat i on ? concerned participants were invited 
to post an 'dea for a change role or situation for which a training 
program of some kind was needed. The question of level was also 
left open. After these ideas were posted a 1 1 the participants were 
asked to read them and to sign up under them i ' they wanted to 
participate in that task force. By this process seven task groups 
were formed ranging in size from two to seven members. in addition, 
four participants ch se to work alone developing their own models. 

The first task force sessions on Tuesday afternoon were intended 
to exp]c“e the role concept under consideration more fully and to answer 
the first question on the outline (role definition and rationale). 

Tuesday evening Havelock, Jung, and Clemens were to screen the prelim- 
inary task Force outputs and provide feedback and comment on additional 
points and ;1 ari f i cat ions that should be made in the Wednesday morning 
d i scus s ions. 

On Wednesday the first two hours were devoted to concluding the 
task force work. At 11:00 a.m. the task force reports were posted in 
the large meeting room and output of each task force was summarized by 
a spokesman. Reactions and clarifications from all participants were 
of f e red . 

A final session o f the conference dealt with next steps which might 
be taken to advance the training of change agents and reactions to this 
conference. This meeting was unfortunately too brief to reach much 
closure and was rated as less than completely satisfactory by those who 
were still present. 

5. Aftermath of the Conference 

At the close of the conference each member was presented with a 
long evaluation form which asked for ratings and reactions to each seg- 
ment including advance materials, over-all design, group sessions, panel, 
informal discussions, and task force meetings. Forty-one responses were 
received representing about 90% of the participants who were able to 
stay with the conference for the three days, exclusive of the chairman 
and organizer. These responses are analyzed In Section III of this report. 

Immediately after the conference Havelock set about preparir guide- 
lines for a model training program for State Education Agency change 
specialists (Interim Report submitted June 30, 1970). In developing this 
plan, he reviewed the task force outputs and panel presentations, and 
followed a modified form of the task force structure (with an additional 
eighth element "utilization of evaluation"). However, it soon became 
evident that the rich and loosely structured output of the conference, 
though a good stimulus, had to be augmented considerably from other 
sources. This training model design is now incorporated as Part VI of 
the "Manual on Educational Change Agent Training" (Attachment #3 of this 
report) . 
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SLnrLi uj in June of 1970, CKUSK staff and assistants including 
Joyce Kornbluh, Roberta McConochie and Mary Havelock began editing 
task force 'eports fi Ming in gaps and composing prose drafts from the 
telegraph n^tes and outl ines left by CECAT. This proved to be a very 
difficult and frustrating task. in some cases they were able to solicit 
revised cop/ from one or another of the contributors. In other cases 
an edited version was circulated among all contributors of that task 
force for comment. In still other cases editorial judgment indicated 
that the primary thoughts should be incorporated in other parts of the 
manual but that a "design" could not be reported as such. These judg- 
ments were sspeclally agonizing because of the Investment of effort 
and interest which the task forces represented to ail concerned. 

Recorders' notes from each of the Monday and Tuesday subgroup 
sessions were also edited and typed. This material is not included 
directly in this report but was used in preparing Parts I - IV of the 
Manual on Training. 

The final task under this contract was intended to be the writing 
of alternative training designs based on the conference (CECAT). The 
State Agenc/ design represented one effort in this direction. However, 
it: became apparent a f ^er the conference (a) that there was a large 
variety of alternative concepts of change role and change process training 
and (b) that the conference, p e i se, did not provide enough detailed 
input for tie full description of any one of them. Therefore the project 
director decided that the optimum product would be a manual on training 
design which would give a detailed analysis of the considerations, 
principles, and elements that should be incorporated In any such program 
regardless af level or specific focus. In addition this manual would 
include the State Agency model (the interim repor of June 1970) as 
a fully developed example, and the most fully articulated task force 
reports as image-makers for would-be program developers in different 
a rea s . 

Project director Havelock had other commitments in the fall and 
winter of 1970-71 which prevented him from following through on this 
"manual" concept. Kornbluh and others attempted to develop this product 
based on existing notes and outlines but they found that they did not have 
enough background to complete the job. The present manual (Attachment #3) 
was composed largely by Havelock in the summer of 1971* 

6. Plans for Final Production and Distribution of the Manual 

After this report is submitted to USOE, the manual will be further 
edited and refined so that it is suitable for publication.* 

A limited edition will then be published probably before the end 
of 1971 anc copies will be sent to CECAT participants as promised 
earlier. Large volume sales of this document are not anticipated 
although its utility to a specialized audience of trainers and training 
designers should be very high indeed. Publication will be by the 
Institute for Social Research publications division and no claim will 
be made for copyright at least over materials prepared for the USOE 
cont ract . 



*Th i s work will be undertaken without the use of Federal funds. 
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By an overwhelming vote of 36“ 3 (with two abstentions) CECAT 
members expressed a desire to reconvene within a two year period. 

We have no current plans to do so but strongly recommend that USOE 
take furthjr steps in this direction. CECAT was not in itself an 
unqualified success; it did not produce the kind of product with 
the detail and clarity we had hoped for, but it did demonstrate that 
there was a great interest in this area across the nation among educa- 
tional leaders, and to some extent it indicated that there is a community 
of thought on what is needed. Another CECAT or series of CECAT5 (regiona 
or topically focussed, perhaps) with adequate funding for advance pre- 
paration aid follow up, would start a significant movement for educationa 
reform in “he United States. 



Section il; EVALUATION OF THE "GUIDE" (PROTOTYPE #2) BY 115 CHANGE AGENTS* 



A . The Rev i ev e rs 

As described in Section I above, letters were sent out in the fall of 
I 969 to 200 edicators in typical change agent roles asking if they would 
agree to reviev the "Guide" for us. This letter is reproduced as Appendix A 
to this sectior. Of the 200 educators whom we initially contacted 15! agreed 
to review the ' Guide" and they returned to us a form giving a brief descrip- 
tion of their professional activities. This form is reproduced as Appendix 
d of this section. When prototype #2 of the "Guide" was prepared we forwarded 
this to them together with an extensive review form, which is reproduced, 
along with its cover letter, as Appendix C to this section. This review 
form was actually completed and returned to us by 115 people, or 75.6% of 
those who had consented to review the "Guide." 

We initially planned to draw our sample of reviewers from four areas 
which we felt were representative of typical potential users of the "Guide." 
These areas weie: 1) State Department of Education personnel who act as 
consultants, coord i na to rs and disseminators; 2) Directors of local innovation 
projects suppot ted by ESEA Title III; 3) Regional Educational Laboratory 
dissemination staff; and 4) professors of education. We did carry out this 
plan but we aho decided to include a sample of educators chosen from local 
school districi personnel. We knew that our sample of Title III directors 
would give us < ome indication of how well the "Guide" would be received at 
the local level, but we also felt that these individuals are often engaged 
in fairly specialized programs of questionable permanence. We therefore 
decided that a sampling of local educators in general would give us a broader 
indication of 1 he extent of the audience to which the "Guide" might appeal. 

We wanted our reviewers to be representative of educators throughout 
the nation, so our initial letter asking change agents to review the "Guide" 
was sent out to educators in all 50 states and the District of Columbia. 

Since not all cf those whom we initially contacted actually completed the 
review form, not every state was represented in the final sample. The sample 
was sti 1 1 widely representative, however, with the 115 reviewers coming f r om 
37 states and the District of Columbia. Table I 1.1 shows the national distri- 
bution by states of the reviewers in each of our five sub-groups, 

[insert Table [1.1 here] 

The positions held by the reviewers were quite diverse, but a brief 
general characterization of those in each group may be made. There were a 
total of 41 reviewers in the State Department group, and of these, 19 were 
directors or coordinators of programs which ranged from vocational rehabili- 
tation to statewide planning and dissemination. Ten were supervisors or 
superintendents of departments within the state departments of education, and 
eight were consultants or research utilization specialists. The four remaining 
members of this group were planners and project developers. 



*This section w as prepared by Mary C. Havelock, 
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table I I . 1 



National Representation 



T = To ta 1 for S :a te 
S = State Department 
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Our reviewers included 21 ESEA Title Ml directors, 14 of whom listed 



themselves ns directors of special programs which ranged from curriculum 
research to in-service education. The remaining 7 members of this group 
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Of 21 reviewers from the Regional Educational Laboratories, one was a 
laboratory director and another was an assistant director. 'Lie group 
included 12 di-ectors or coordinators of various programs such as individual 
learning and teacher training. The remaining seven reviewers in this group 
held a variety of positions, mainly as assistants to the professional staff 
of the ! abora t sr i es . 



Our sampl of 21 local school educators included six superintendents 
of schools and three principals or vice-principals. Nine members of the 
group were directors of programs which typically served an entire school 
district; "Director of Research, Development and Planning 1 ’ and "Director of 
Secondary Education" were typical job designations. One reviewer was an 
educational researcher and two were administrative assistants. 

Our sample of professors of education was the smallest group, with 
only seven respondents in this category. Their areas of specialty ranged 
from community activities to educational research. 

Four addiiional educators who reviewed the "Guide" could not readily 
be classified as belonging to one of our five respondent groups. These 
included a Program Manager for the Department of Health, Education and 
Welfare and a director of educational research and training. We combined 
the responses of these educators with those of the professors of education 
to make a total group of 11 respondents which we designate as "other" in 
reporting the -esponses to the review form. 

We asked all our reviewers to indicate the activities in which they 
were involved as educators and change agents, either full or part time 
(see Appendix 3 of this section). Their responses to this question are 
presented in Table I I ,2, which shows the percentage of each respondent group 
involved in ea ;h of 12 areas of professional activity. 

[insert Table 11.2 here] 
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All groups have a very high percentage of respondents engaged in 
administrative duties, with a total of / 1 . of all respondents spending at 
least part of their time in this area. Just as outstanding is the fact that 
apart from the "other" group, which includes the university professors, a 
very low percentage of respondents are engaged in teaching. 

The balance of their time seems to be spent primarily in research, 
development, in-service education, and consultation, with some groups being 
quite involved in committee and task force work. They also have apparent 
high interest in maintaining professional relationships; 80| of respondents 
belong to at least one professional organization, and the average number of 
memberships for all reviewers is four. Judging from this profile I think we 
can conclude that these educators are indeed acting in typical change agent 
roles; they are interested in and have access to many sources of new ideas 
and they are engaged in many activities which would serve to bring their 
information to the attention of others. 



M 



-33- 



TABLE 



P f o f 6 s s i o nil 1 Act i v i t i e s of Rav i ©wo rs 



| S t-'te I Title 
| Dept. | Ml 


! j 
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Other 


! ! A1 i 0 r -i~ 

Total 
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i ! 


Average Age 


1 45 | 47 


38 


| 42 ! 

! 


r 

44 


Y at; 


Highest Academic Degree: 
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Bachelors ! 
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"Percents for each group Ho not total 
than one I tem. 



'‘o because respondents could check more 



T "The percent of "Title I I I group" respondents who Indicate they are involved In 
Title Ml programs does not total 1001 because some respondents in that group had 
recently completed their Title III programs. We left them In this group since 

_ eir res P°nses to the handbook would still be representative of those of other 
Title Ml program di rectors . 
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One additioral fact might be noted; none of our sample of local school 
district personnel turned out to be engaged in ESEA Title Ml programs. Thus 
our judgment tfat Title ! 1 ! program directors would not necessarily repre- 
sent a typical sample of educators at the local level seems to be correct. 

B • Responses to the Review Form 



There was no Specific question 
to give an overall evaluation of the 
extent of their interest in each individual 
responses are presented in Table II. 3 . 



on tne review form askinc 
''Guide. 11 Reviewers were 
section, however. 



the responded '.s 
asked about the 
and these 



TABLE 11.3 Overall Interest in the Handb ook ; 

Percent Rat i ngs 





Very Good - Good 
Quite 1 nteres t i ng 


Adequate 


| Somewhat I n- 

adenuate - Very 
! nadequate 


i 

Tota 1 


Somewha t 
1 nteres t i ng 


Not Very 
1 merest i ng 


1 n t roduc t i on 


75.3 


18.0 


6.7 


100 


Case Studies 


60.7 


35.9 


3-4 


1 00 


Stages* 


79.7 


15.1 


5.2 

\ 


100 


Total Handbook 


76.4 


18.4 


5.1 


100 



-^Ratings are given for each individual stage in Table I 1.9. 



The Introcuction and each of the chapters on the six stages were rated 
on a 5“po i nt scale from very good to very inadequate. The top two categories 
(very good and good) were combined in the above table, as were the lowest two 
categories (somewhat inadequate and very inadequate). The case studies were 
rated on a 3-point scale of "quite interesting," "somewhat interesting," and 
not very interesting. We feel we made an error in judgment in asking for a 
rating on this particular scale since the words "somewhat" and "quite" do not 
convey precise levels of distinction. 

Despite possible confusion on this score, however, we can still see 
clearly from Table 11.3 that the "Guide" as a whole was very favorably received 
with 76.41 of all reviewers rating it as good or very good in interest. 

1 . Evaluation of the Introduction 

In sedition to asking the. respondents to rate the Introduction 
on interest level, we asked questions which we re designed to el left 
the reviewers' judgments as to whether or not the introduction was 
effective in fulfilling its objectives. In response to the question 
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Does it serve to show who a 'change agent' is?" the reviewers 
rated it as ^0 on a five point scale “(with 5-0 representing 
"very good" and 1.0 representing "very : .adequate") . On this 
same scale the question "Does it make the objectives of the 
handbook clear?" received a mean response rating of 4.1. 

In order to aid us in the revision of the Introduction 
we asked several additional specific questions wh i ch received 
the following mean responses (again 5 represents "very good," 

1 represents "very inadequate"): 

writing style: 4.3 
organization: 4.0 

clarity of pictures and diagrams: 3-1 
value of pictures and diagrams: 3,6 

We felt that although the general reception of the Intro- 
duction was good, the responses nevertheless indicated some 
deficiencies. We therefore rewrote the introduction, making 
a particular attempt to improve the pictures and diagrams. 

2. F valuation of the Case Studies 

The rationale for inclusion of the case study materials 
was, of course, to give concrete examples which would serve 
to illustrate the material of the later chapters ("stages"). 

The case studies could be considered a success only if they 
adequately served this purpose. We therefore asked our review- 
ers whether they found the references to the case studies in the 
text of Part II to be useful. The response was gratifying; 

80.0% of reviewers did feel they were useful. Another 3.4% 
felt. they were not needed, while 10.6% found them to be either 
difficult to follow or distracting. Because of this very 
favorable response, we added more references to the case studies 
when we prepared Prototype #3 of the "Guide." 

Table 11.4 shows responses of the reviewers to questions 
about the detail, length and number of case studies presented. 

[ I nsert Table 11.4 here] 

Clearly we hit it just right in terms of length and detail 
of the case study material. We seem to have about the right number 
as well, although 23*3% of reviewers would have liked to have 
mo re . 

We were al so interested in how relevant each individual case 
study might be to the experience of each group of respondents. 

Reviewers were asked to rate each case study on the basis of how typical 
It was of situations in which they themselves or someone they knew were 
involved. These responses are given in Table I I . 5. 

[insert Table 11*5 he re] 
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TABLE 11.4 



Case Study Detail, Length and Number : 
Percen t Rat i ngs 



i 





! 

1 

Too 

Detai 1 @d 


Right Amount 
of Detai 1 


Not Enough 
Detai 1 


» 

T 0 t a ] 


Detai 1 


GO 

cN? 


83-71 


8.1: 


1001 




I do Long 


Right Length 


Too Short 


1 

1 

Total 


Leng th 


10.51 


83-71 

1 


5.8% 

j 

! 


L 

! 

! 1 00% 

, 




i 

T oo Many 

— — • — — — ■ - - — — 


Right Number 


1 

1 

Too Few J 


Total 


Number 


&e I 

C\ J 


73.51 


25.31 


1 001 




TABLE 11.5 Typicality of Each Case Stud y: 

Mean Rating* by Each Respondent Group 



• ' a - _____ 


Linda 

(Black 

Studies) 


M i ke 
(Sex 

Educat i on) 


S t eve 
(Staff 

(Development) 


| Henry 

! (Soc i a 1 S tud i es 

Cu it i cul um) 


1 

i 

; TOTAL 


State Dept. 


3.3 


4,1 


4.5 


3-3 


3.3 


Title III 


3.3 


4.3 


4.2 


r 3 - 5 


3.8 


R. E . L. 


3.2 


4.3 


3-7 


3.8 


3-8 


Loca 1 


3.6 


4.4 


4. 1 


3.3 


4.0 


Other 


3.8 


4.3 


4.7 


3.6 


4.1 


Total - 
A i 1 Groups 


3.4 


4.3 


4.2 


3.6 


3.9 



* 5 = "very typical"; 1 = "not typical" 
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Though two or the case studies (Hike and Steve) were regarded 
as more typcial than the others, the case studies as a whole 'were 
rated as quite typical. Over all, the selection of case studies 
had roughly equivalent appeal to each group of respondents, a 1 though 
certain case studies seemed to be considered especially typical by 
different croups. Each group rated at least one case study at least 
as high as 4,3; the case study materials seem to be representative 
of a wide variety of change situations in education. 



In Table li. 6 we show the percentage of respondents who rated 
each of .,ne case studies in each level of typicality *en though 
the cases of Mike and Steve clearly led in ratings, t. Table show* 
that a large portion of reviewers considered the cases cf Linda and 
Henry as equally or more typical. 



TABLE 11.6 Typicality of Each Case Study: 

Percent Ratings by all Respondent Groups Combined 





Very 

Typical 

c 


4 


3 


2 


Not at all 
Typ i cal 
1 


TOTAL 


Linda 


23.3 


24. 4 


27.9 


16.3 


8. 1 


100 


M i ke 


6C . 2 


I 7 .O 


13.6 


6.8 


2-3 


1 00 


S teve 


i cm 

OO 


33.3 


12.6 


4.6 


1 . 1 


100 


Hen ry 


21.2 


43.5 


16.5 


10.6 


8.2 


100 


TOTAL 


3£.4 


29.5 


17.6 


9 . 6 


4.9 


100 



3. FJvatua tion of the Six Stages 

We were particularly concerned to find out whether the organiza- 
tion of the handbook around the concept of six "stages" of innovation 
would be judged as realistic and helpful by typical change agents. 
Responses to questions eliciting this information are presented in 
Table I I « 1. 



[insert Table 11.7 here] 

We were pleased to find that our reviewers did consider these 
"stages" to be clearly defined as distinct steps in the process of 
innovation; 83-7% felt that they were "mostly clear" or "very clear." 





TABLE 11.7 
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The Six S tage Model 



Percen 1 


t Ratings 








Mean 
Rat i ngs- 


Are the stages 
distinct steps 
i n the process 
of I nnova t i on? 


— \/e?y 
C 1 ea r 


Mos 1 1 y 
Clear 


Adequatel y 
Clear 


Somewha t 
Clear 


Not at al i 
C 1 ea r 


Total 


4.3 


55.8 


27, S 


11.6 


3-5 


1 .2 


100 


Are the stages 
divided into 
useful g roup i ngs 
for your change 
efforts? 


Very 
Usef u 1 


Mos tl y 
Usef u 1 


Adequate 1 y 
Usef u 1 


Not too 
Usef u 1 


Not at all 
Useful 




3.9 


34-5 


33*3 


24.0 


8.3 


0 


100 


A re the i nd i v i 
dual stage 
ma te r i a 1 s usef u 1 
- do they apply 
to you r own 
work?** 


Ve ry 
Good 


Good 


Adequa te 


Somewha t 
1 nadequate 


Very 

i nadquate 


100 


4.3 


54.3 


27.6 


1 1.7 


5 • 1 


1 . 2 



* 5 = "very clear"; "very useful"; "very good" 

1 - "not at £ 1 1 clear"; "not at all useful"; "very Inadequate" 

** Responses to this question are given for each respondent group and each stage 
i n Tables I ! . 11.9 and I ! . 10. 



The ether two questions in Table 11.7 show an apparent discrepancy. 

The first of these questions on the usefulness of the six stages was 
asked relative to the six stage model . The second was asked with 
regard to the usefulness of each individual stage, with the responses 
to each of the six stages being combined in this Table. Evidently 
the reviewers found it easier to see the utility of each stage individually 
than to imagine themselves as approaching innovation in terms of a six 
stage process. Hence, it may be somewhat more difficult for change agents 
to accept the overall strategy suggested In the "Guide" than to adopt 
specific procedures and tactics related to the strategy. 

Tables 11.8, 11.9, and 11.10 give detailed responses to the 
question on usefulness which was asked about each individual stage. 

The question was: "Usefulness: could you think of ways this stage 
applied to your own work?". Table 11.8 shows the mean ratings each 
respondent group gave to each stage. 
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TABLE 11.8 




Usefulness of the 


s 


I x S taqes : 










Mean 


£ i ny o 


f cdth s tdye 
group 


by each respondent 






Group 


Relation- 

ship 

Building: 
Stage 1 


D i agnos i s: 
Stage 1 1 


Acqu i r- 
i ng Re- 
sources : 
Stage III 




Choos i ng 
Solution: 
Stage IV 


Gaining 
Accep- 
tance : 
Stage V 


S t a b i - 
1 i 2 i ng : 
Stage VI 


A1 1 

Stages 


State Dept. 


4.5 


4.3 


4.1 


4.5 


k s 6 


4.4 


4.4 


Title II 1 


4.7 


4.2 


4.0 


4.5 


4.2 


4.0 


4 . 2 


R.E. L. 


4. 1 


4.2 


3-7 


4.2 


4.7 


4.4 


4.2 


Loca 1 


4.2 


4.4 


3.9 


4.1 


4.2 


4.5 


4.2 


Other 


4.3 


4.5 


4. 1 


4.4 


4.8 


4.0 


4.4 


TOTAL 


4.4 


4.3 


4.0 


4.4 


4.5 


4,3 


4-3 



r 



” 5 - very good, 4 - good, 3 - adequate, 2 = somewhat inadequate, 1 - very inadequate 



Table 11.9 presents the percent ratings to this same question on 
each stage by all reviewers combined. 



TABLE i I . 9 



Usefulness of the Six Stages 
Percent ratings of each stage by all 
rest 



ERjt 



S tage 


Very 

Good 


Good 


Adequate 


Some- 
what In- 
adequate 


Very In- 
adequate 


Total 


1 , Re 1 a 1 1 on- 

ship Bui Id i ng 


59-3 


25-9 


8.6 


4.9 


1 .2 


100 


I i . D i agnos I s 


55.7 


28.4 


9. 1 


5-7 


1 . 1 


100 


III. Acqu i ring 
Resources 


42.7 


28. 1 


15-7 


11.2 


2.2 


100 


IV. Solution 
Choos i ng 


58.8 


23.5 


12.9 


3-5 


1 2 


100 


V . Gaining 
Acceptance 


60.2 


28.9 


7.2 ! 


! 3.6 


0 


100 


VI . Stabi 1 1 zation 


50.0 


31.0 


16.7 


1 .2 


1 .2 


100 


All Six Stages 
Comb i ned 


54.3 


27.6 


11.7 


5.1 


1 .2 


100 
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iable 11.10 presents the percent ratings by each respondent q roup 
of all six stages combined. 

TABLE 11.10 Usefulness of the Six Sta ges 

Percent ratings by each respondent group of 
all six stages combined 



G roup 


Ve ry 
j ood 


Good 


Adequate 


Somewhat 
1 nadequate 


Very 

1 nadequate 


Total 


State Dep t . 


59-5 


26.0 


9.2 


4.6 


0.6 


100 


Title II! 


55-9 

i 


23.4 


10.8 


'9*0 


0.9 


100 


R. E. L. 


47.2 


36.0 


10.1 


3.4 


3.4 


100 


Loca 1 


49.5 


27.8 


17.5 


4. 1 


1 .0 


100 


Other 


55.0 


27-5 


15.0 


2.5 


0 


100 


TOTAL - A1 1 
Groups 


54.3 


n =7 f. 

lf*Q 


11.7 


5. 1 


1 .2 


i 100 



These three tables show no clear differences among the respondent 
groups on how useful they consiJer the six stages to be as a whole. 
However, different groups seem co feel that different stages apply more 
directly to their own work. The tables also s how that although Stage II! 
received an overall "good" rating, it is regarded by all groups to be 
the least usef u 1 . 

The ovsral 1 rating of interest in the six stages was presented in 
Table 11.3. In Table 11.11 this information Is presented for each of 
the stages individually. 

[Insert Table 11.11 here] 

Stage III seems to be lagging behind in interest as well as in 
usefulness, but apart from this we were very pleased with the reaction of 
our reviewers to the stages. Only 5.2% of respondents felt the six stages 
to be of inadequate interest, and only 6.31 felt them to be of inadequate 
usefulness. 
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TABLE I ! . ] 1 



interest of the Six Stages 

Percent ratings and mean ratings of each 
stage by all respondent groups combined 









3 ercent Rat 


i ngs 






Mean Ratings 


Stage 


Very 

Good 


Good 


Adequate 


Some- 

wha t In- 
adequate 


Ve ry ! n 

adequate 


Total 


— — . _ =J 

< 


1 . Relation- 
ship Building 


42.6 


38.3 


14.9 


4.3 


0 


100 


4.4 


II. D i agnos i s 


44.8 


33.3 


16,1 


5.7 


0 


1 00 


4.2 


III. Acqu i r i ng 
Resou ices 


34,6 


29.6 


23-5 


12.3 


0 


1 00 


3-8 


IV. Solution 
Choos i ng 


54.8 


29.8 


i 1.9 


3.6 


0 


1 00 


4.4 


V . Gaining 

Acceptance 


55.6 


32. 1 


9.9 


1 .2 


1 .2 


100 


4.4 


VI. Stabili- 
zation 


43.4 


39.8 


14.5 


2.4 


0 


1 00 


4.2 


All S i x S tages 
Comb i ned 


46.2 


33-5 


15.1 


5.0 


0.2 


100 


4.2 



* 5 = "very good"; 1 « "very inadequate" 



Finally, we asked several more questions designed to aid us in our 
task of revising the "Guide." We asked the reviewers to rate each stage 
on writing style, organization, completeness and value of quotations. 

The mean ratings on these ranged from 4. 0 to 4.3 on all stages combined 
but Stage ill received the lowest ratings on each of these dimensions 
U.b - 4.0). This information, together with the fact that Stage III 
had rated owes t. on interest and usefulness, led us to the conclusion 
that Stage Ml would need the most extensive revision. Accordingly we 
completely reorganized and recomposed Stage Ml, and we fit much more 
satisfied with it as it appeared in the new draft, Prototype #3. We 
made minor changes in the other five stages in response to specific 
suggestions by reviewers. 

4. Evaluation of the Appendices 



We asked the reviewers to rate the usefulness of each appendix as a 
re ^ eience to other more complete resources which a change aoent 
might want to use. These responses are presented in Table II M2," 

[ I nsert Table 11.12 here] 

We found these responses to be very gratifying, and we were especially 
pleased to note that only 1 . 71 of reviewers considered the appendices to 
be of little value. Thus, apart from the updating of Appendix C, which 
was necessary due to obsolescence, we felt no significant changes in the 
appendices were called for in the preparation of Prototype #3. 
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T ,\ Dir i 

! r-\U LL I 



i n 

i d. 



Use fu > nes b uf Lhe Appendices 
Percent ratings and mean ratings 



Append i x 


Percent Ratings 


Ve ry 
Useful 


Mos 1 1 y 
Useful 

■ 'i 


Adeq ua te 1 y 
Useful 

- n 


Not Too 

Useful 


Not at All 
Useful 


Tota 1 


A, Strateg i es 
and Tactics 


58,5 


24.4 


13.4 


3.7 


0 


100 


B , 1 nf ormat I on 

Sources 


66 . 7 


22.2 


9.9 


1 . 2 


0 


100 


C, Annotated 
B i b 1 iog raph^ 


58.9 


27-4 


13.7 


0 


0 


100 


Total - All 
Append i ces 


61.4 


24.6 


12.3 


1.7 


0 


100 



Mean 

Ratings ” 



4.4 



4.5 
4 . 



4 . 5 



* 5 = "very useful"; 1 = "not at all useful" 



Evaluation of Proposed Additions to 



the "Guide" 



We proposed several additions which might be made to the "Guide" and 
asked each reviewer to evaluate each on the basis of potential usefulness 
in his owr particular work as a change agent. These responses are given 
i n Tab 1 e I I . 1 3 . 



TABLE 11-13 Desirability of Propo sed Additions 

Percent ratings and mean ratings 





Percent Ratings 


Mean 

Ra t i ngs* 


Essential 


Good 
1 dea 


NO 

Opinion 


Not 

Necessa ry 


Bad 
! dea 


Tota 1 


4.1 


Section on 
p repa r i ng 
for the role 
of change 
agent 


29.5 


57.7 


7-7 


5-1 


0 


1 00 


Check! i s ts 

for each 
stage 


35 . 1 


44.2 


13.0 


6.5 


1.3 


100 


4 . 1 


Training 
P t og rams 


VjJ 
\r i 


48.1 


7.8 


9 . 1 


0 


100 


4 . 1 


Appendix of 
names of 
other change 
agents 


J 3 ... 2 


51.3 


11.8 


21 . 1 


2.6 


100 


3.5 



* 5 = "essential"; 1 = "bad idea" 
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These responses confirmed what we had already suspected; several 
additions to the handbook could prove to be very valuable and useful. 
Checklists of procedures and major points have been prepared to accompany 
each of the six stages. These checklists, as we mentioned above, are 
contained in "Attachment til" of this report. 

We described in Section I above the history of our development of 
change agent training program designs. The design which evolved, and 
which we have called "Manual on Educational Change Agent Training," 
is A t tachmc-n t it ? of this report. 

Rather than adding a section on preparing for the role of change 
agent 10 1 1 <*. "Guide" itself, we have included an extensive discussion of 
this subject in the Training Manual. Additionally, we have amended the 
Introduction of the "Guide" to include more discussion on defining the 
role of change agent. 

Ccnsicerlng the relatively low response rating given to the idea 
of adding an appendix of names and addresses of change agents, and also 
considering the difficulties involved in keeping such a list up to date, 
we have decided against making such an addition. Thus, all but one of 
the proposed additions suggested above have now been prepared. 
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Section II 
APPENDIX A 



Letter of Invitation to Potential 
Reviewers of the ''Guide" 

(Prototype #2) 




; ! ■ n 



run rfklarch 



ON UTILIZATION of SCIENTIFIC KNOWLEDGE / INSTITUTE FOR SOCIAL RESEARCH / THE UNIVERSITY OF MICHIGAN 

ANN ARBOR, MICHIGAN 48100 



i am waiting to ask for your help in reviewing a new book. We are developing a 
Handbook on the process of change and Innovation in education. The book, A Guide to 
innova tion in Education , is written for educators who are involved in getting Innova- 
tions implemented by schools and school systems. It describes the process of change 
within individuals, groups, and organizations and suggests specific procedures that 
can be used to facilitate this process. This handbook is based on considerable re- 
search on how people acopt innovations and come to utilize scientific knowledge. The 
research material was reviewed by Dr. Ronald G, Havelock in a report entitled The 
Dissemination and Util! zation of Knowledge- A Comparative Survey and Theoretical 
Analysis of the L i teratu~re~ , 1 363 ", now available through ERICf, (Both projects are 
being supported by the Research Utilization Branch of the U.S, Office of Education,) 

In order to test the relevance of our efforts on the handbook, we need to get 
the -evictions of a few key educators to our first draft We would like to have you 
■,:ud over the first draft and give us your reactions to it on a brief questionnaire. 
For your help we wull send you a complimentary copy of the final version of the hand- 

f \ i n k , 

We would send you the draft and questionnaire early in October, hoping to make 
l ho final version available by February, 1370, Naturally, we would want to have 
your responses as early as possible for use in revising the draft. 

We have enclosed with this letter a copy of the introduction to the handbook 
if, i ,"i reading >t over, you feel that you would like to participate In reviewing the 
d r n r ~ t of the entire work, please return the enclosed form to us by September ig, 1969- 
lf the handbook is not relevant to your particular job, please pass this information 
along to someone else in your organization whom you think would find such a tool use- 
ful. 

If you have any questions, do not hesitate to call me collect at (3131 764-2(360 

Sincerely, 



(Mrs.) Janet C, Huber 
Assistant in Research 

JCH : rw 



nc 1 osu res 
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Section II 
APPENDIX B 



Form for Background 
Information on Reviews 



O 

ERLC 
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* would like to^ receive a comp 1 I men t ary copy of the final version of A Guide to 
Inn ovation in Ed uca if i o n in exchange for reading the first draft of this manual and responding 
to a brief questionnaire about it. 

Name : 

Title: 

Organization: 

Add ress : 



Education (Number of years or highest degree earned ana field of specialization) 



r\Cjc * 



Please check ALL of the following items that describe your current role (either part- 
time or full time) as an educator and change agent. 

f each i ng (Subject and/or grade level: 

Spec! a 1 Services (instructional Materials Specialist, Reading Consultant, et^ 

Sped f y : 

Counse 1 ! ng 

A dm 1 n i s t rat 1 on 
Research 

Deve 1 opmen t 

In-Service Education Instruction 

Consul tat i on (Type of client and speciality: ' 

T itle I - ESEA (Type of Project: ] 

Project Pi rector ” Project Staff — — — — - - 

T itle III - ESEA (Type of Project: ) 

Project PI rector Project Staff 

_ ^Participation in Committee, Task Force, Project, etc. (Please list the title of the 

groups and clarify, if necessary, on the back of this form) 

M embe rsh i p in Professional Associations (Please list on the back of this form) 

O the r (Please specify: ) 



Return this form In the enclosed envelope to: INSTITUTE FOR SOCIAL RESEARCH 

P.0. Box 1 248 

The University of Michigan 
Ann Arbor, Michigan 4 8 1 06 

O 

ERIC 
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APPENDIX C 



Reviewer Questionnaire 
and Cover Letter 
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M HIM HfStAHCH ON U III IM1 ION U SUINIIFIC KNOWII DGI / INSTITUTE FOR SOCIAL RESEARCH /THE UNIVERSITY OF MICHIGAN 

ANN ARBOR, MICHIGAN 48106 



December 2, 1969 



i n 



Thank you for offering to assist 
jn. Education . Enclosed is the first draft of that i Tndbook 



leviewing A Guide To Innovation 



?r ,8ed in ^^t— \rCwuh 

glance through the questionnaire first and then fill in you- reacting 

suggestions "on' i ^ We a1s ° Ur9e ^ add comm ts and 

.-ggestions on issues not adequately covered in this quest ionr. re. 

We regret that we were unable to send you this Hr a f- -a-lv a- w- 
nad hoped but we would appreciate the return of your'ques ion a e at 

iZuZitv : onven : ence - we d ° *tm expect to y have q thr;r na r ;: r : on 

available someth this spring and will be sending you a copy at 



c a 



«,',ic f t y :t (3U) q 76?-2560.° n ^ ° f th# e " C,0S * d 



please 



S i new rely. 



Ronald G. Havelock, Ph.D. 
Project Director 



Enclosure: A Guide to I 



— nnovat i on in Education 

Rt - v i ewer Quest ionnai re" ~ ~ — 

Return envelope for goes t i onna i re 



O 

ERIC 
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REVIEWER QUESTIONNAIRE 



A Guide To 
Innovation In 
Education 



by 

Ronald G, Havelock 






The sections of this questionnaire correspond to parts in the handbook; 



A , I nt roduct i on 

B , Case Studies 

C, S ages of Planned Change 

D , Appen dices 

E, Proposed Additions to the Handbook 



Each section contains (1) a statement of the author's goals for that part 
of the handbook, and (2) several questions to get your reactions both to the 
goals themselves and to the manner In which they were fulfilled. 




REVIEWER: 
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A. INTRODUCTION 

The introduction should attract the interest of people who see themselves as 
change agents. It should clearly indicate what a change agent is and should suggest 
the main objectives and contents of the handbook. 



Very 

Good Good 



Somewhat Very 

Adequate Inadegua t e I n a de c u t 



1. Writing Style 

2. Organization _____ 

3 • I n te re s t 

k. Clarity of Pictures and 
D i ag rams 

5- Value of Pictures and 
D i ag rams 

6. Does it serv'e to show 

who a ‘change agent 1 is? 

7- Does it make the* objectives 
of the handbook clear? 

8. Do you have specific suggestions for the introduction? 
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B. CASE STUDIES 

it is hoped that the case studies of real change agents' experiences ("Part 
One" of the handbook) will substantially increase the relevance of the handbook 
for the practitioners o f change in education. Because so few of those people who 
are now serving as 'change agents' recognize t hemse 1 ves - -or are recognized by 
oth^rs--as such, it is hoped that the variety of roles defined in the case studies 
as 1 change agent' will lead many readers to identify change agent activities in 
t he i r own role. 



Are the case studies which were used typical of the kinds of problems 
and situations that you anu other change agents you know are involved 
in? (CHECK THE SPACE FOR EACH CASE STUDY which beTtTndi ca tes how typical 
it is.) 

Very ^ _ Not 

Typical - Typical 

12 3^5 



a. Linda (black studies): 

b. Hike (sex education): 

c. Steve (staff development): 

d. Henry (social studies curricula): 



2, Would some other example have illustrated the relevance of the handbook to your 
work more effectively? 



Did you find that the case studies presented were (CIRCLE ONE FOR EACH LINE): 



a * 


too 


de ta i 


1 ed 


about the 


right amount of detail 


not enough de ta i 1 


b , 


too 


1 ong 




about the 


right length 


too short 


c. 


not 


very 


interesting 


somewhat 


i nte res 1 1 ng 


quite i n te res 1 1 ng 


d. 


too 


many 




about the 


right number 


too few 
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Were the references to case material (see e 

Part Two , . . 



xample below) in the text Q f 



page 37 : 



THE EFFORTS OF DOTH STEVE AND 
MIKE WERE THWARTED BY OPPOSITION 
FROM ORGANIZED CITIZEN GROUPS. 



jjsefu for relating the theory to real life? 
not needed? 



difficult to follow? 
d i s t r a c t i n g ? 



5. Plea53 indicate (by page number and, where necessary for clarification, 
name of the change agent) any references to case studies which you f e i t 
not useful--or would be confusing to the reader. 



the 
we re 
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STAGES OF Fl NNED CHANGE 



Part Two of the handbook contains the principles nhoto ,-u^ . . 

,iq<in try which have been gleaned from the research " 1 i -p'r r an 9 e and change 

principles have been presented in six " ‘■ erature 0n innovation. These 

change from the pot t of view'o the' channHaenT ’™??" 1 ‘ " 9 ^ process of planned 
organization wou , d be the most appropriate 3 for a handbo^ 5 hV-' f h *‘ thiS 
USe * —ners^s W i^. 



The 



i x 



e Model 



Are the stages clearly defined for you as distinct 
of innovation? (CIRCLE ONE) 



i n 



Very clear Mostly clear Adequately clear Somewhat c 



ear 



p rocess 

Not at 
all clear 



Are the stages divided into useful groupings for your chanaP * - 
in the field? (CIRCLE ONE) J ,our Chc,l| y e ei.orts 

Vary useful Mostly useful Adequately useful Not too useful aH usefu 



3- Should other stages be added? 



yes , 1 spec i f y) 



nould some stages be dropped or combined? 



Was the dual 



column page set-up used throughout the six stages helpful? 



The Specific Stages 

(This section of the questionnaire includes a 
of the six chapters in "Part Two" of the handbook.) 



one-page 



rating sheet 



for each 
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Rat i n g of; ' ' $ t a g e I ; Bui 1 ding a Relation ship" 



Writing Style 
(clarity, f 1 ow , 
cone i seness ) 



2 . Organ i zat i on 

(Was "he structure 
of the chapter clear 
and readable?) 

3 - Comp 1 e tenes s 

(Was the topic 
adequately covered?) 

^ Interest 

(Did " t hold you r 
.'it tent ’ on?) 

5- Usefulness 

(Cou 1 d you think of 
ways that i t appl i ed 
to your own work?) 

6. Value of Quotations 
(Were they usually 
1 on t a rge t 1 ? ) 



Ve ry 
Good 



Good 



fidequa 



Somewha t 
I nadequa te 



Ve rv 

j^nadequa to 



7. 



Are there any important 



issues which we have neglected? 



8 . 



Do you have any disagreements 



with the position statements that we have 



made? 



9- Ar? th 



ere any positions that you would like to see emphasized? 



10. Do you have any other suggestions for the chapter or comments on the above 



points? 



O 
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Rat i nq of: "S t aos II: D : aqncs i nq t h<; Problem" 



Writing St"- 1 e 
( o 1 a r i t v , flow, 
cone i ?eness ) 



V e r y 
Good 



Good 



adequate. 



S o "K- what V ( ■ r y 

1 njd equa te I n , i d e q u 



2 . Organ i za t i on 

(Was the structure 
of the chapter clear 
and readable?) 

3. Completeness 
{Was the topic 
adequately covered?) 

ft . I n t e re s t 

(Did it ho.l d you r 
a t ten t i on? ) 

5. Usefulness 

(Gould you think of 
.ways that it applied 
to your own work?) 

6. Value of Quotations 
(Were they usually 

1 on ta rge t ' ? ) 



Are there any important Issues which we have neglected? 



Do you have any disagreements with the position statements t 



hat we have made? 



9* Are there any positions that you would like to see emphasized? 



Do you have any other suggestions for the chapter or comments on the above points? 
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Rat i ng of ; "Stage IN : Retrieving Re levant Knowledge" 





Very 








Sonvewha t 


Vi,.’ f V 




Good 


Good 




Adequate 


i nadequa te 


i HiKleq Ui 


Writing Style 














(clarity, flow, 
cone i senes s ) 















2 . Organ i /at i on 

(Was the structure 
of the chapter clear 
and readable?) 



3 . Completeness 
(Was the topic 
adequately covered?) 

4 . I n te res t 

(Did it hold your 
attention?) 



5 . Usefulness 

(Could you think of 
ways, that it applied 

to your own work?) _____ _____ 

6. Value of Quotations 
(We re they usually 

'on target'?) _____ 

7. Are there any*, important issues which we have neglected? 



8. Do you have any disagreements with the position statements that we have made? 



9, Are -there any positions that you would .ike to see emphasized? 




10. Do you have 



a>vy o,frfre<_luggest Ions for the chapter or comments on the above point' 





vri 
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uf ' "Stage I 7: Select ing tHe I nno v ati on" 



Writing Style 
(clarity, flow, 
cone i seness ) 



2 . Organ i zat i on 

(Was ' the structure 
of the chapter clear 
and readable?) 

3- Completeness 

(Was the topic 
adeciuately covered?) 

k . Interest 

(Did it ho I d you r 
a t ten t i on ? ) 



Useful ness 
(Could you think of 
ways that it applied 
to your own work?) 

6, Value of Quo tat ions 
(Were they usually 
'on t a rge t 1 ? ) 



7. Are there any important issues which, we have neglected? 



8, Do you have any disagreements with the position statements that we have made? 



3, Are there arty'* p os i t. i ons that you would like to see emphasized? 



10. Do you have any other suggestions for the chapter or comments on the above points? 




Vo ry 
Good 



Good 



Somewhat Very 

A rl 1 “* r-* I * ,.J . 1 , -j *■ ! . . 1 

r wJ m tj t-j l c. ; 1 1 1 a u ^ ‘ U U t fj i f i f. } ij t ; u i.i '} 



Rating of: Stage V_: Gaining Acce ptance^ 



1 , Writing St y 1 e 

(clarity, f 1 ow , 
cone i seness ) 



0 r gan i 2 a t i on 
(Was the st rue tu re 
of the chapter clear 
and readable?) 



3, Completeness 
(Was t ne top i c 
adequate 1 y covered?) 

4 . interest 

(Did It- hold ,yot r 
attention?) 



5 . Usefulness 

( Cou lj you think of 
ways that it applied 

to your own work?) _ ______ ' _____ 

6. Value of Quotations 
(We re they usually 

'on target'?) 

7. Are there any important issues which we have . neg lected? 



8 . Do you have any d i s ag reeme nts with the position st a t ere n ts that we have made? 




v c r y 
Good 



Good 



Adequate 



nadequate 



1 



9 , Are there any positions that you. would like to see emphasized? 



10. Do you have any other suggestions for the chapter or comments on the above points 



0 
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R ating of: "Stage VI: Stabilizing the Innovation and Terminati ng the Re lot ion ship" 



6 . 



Writing Style 
(clari ty , f 1 ow 
cone I seness ) 

Or gan i za 1 1 on 
(Was the structure 
of the chapter clear 
and readable 7 ) 



c* tones s 
(Was the topic 
adequately covered?) 

I n te res t 

(Did it hold you r 
attention?) 

Use f ul ness 
(Cou I d you th i nl, of 
ways that it applied 
to your own wo rt ?) 

Value of Quotations 
(Were they usually 
1 on ta rge t ' ? ) 



7 • A re the re a 



Ve rv 
Good 



Good 



Adequate Inadeq 



iorrewna t 
nadequa te 



Ve ry 

I na dequa ti 



ny important Issues which we have neglected? 



8. Do you have any disagreements with the position statements that we have made?' 



9* Are th 



ere any positions that you would like to 



see emphasized? 



0. Do you have any other suggestions for the chapter or 



comments on the above points? 



O 
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D. 




The three appendices included in this handbook ( n Part Three") are intended 
simply as a handy reference to other, more complete resources that s change agent 
may want to use. 



How would you ‘ate each of the appendices? 

Ver V Mostly Adequately Not Too Not At All 

Useful Useful Useful Useful U s e f 0 1 

a. Appendix A: Strate- 
gies and Tact i cs 



b . Appendix E: Major 

I n format i on Sources 



Append i x t : Major 
Works on Change 



2 . Vh Me realising that this handbook cannot provide an exhausti ve 1 i s t i n g 
educational resources, we wish to correct any glaring oversights. Have 
add i tional suggestions for inclusion in: 

a. "Strategies and Tactics: A Glossary and Guide to Selection" 

V 



b. "Major information Sources in Education; A Directory" 



"Major Worlds on Change In Education: An Annotated Bibliography" 



of 

you any 
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E, PROPOSE) ADDITIONS TO THE HANDBOOK 

This handbook is one part of a long range development program for innovation 
in education. The program calls for a variety of designs for enhan cing the linkages 
between educational resources and educational clients. Among them will undoubtedly 
ne some further revision of this handbook. In this initial version much thought was 
given to future adaptations to incorporate new information as it became available. 



What additional aids would be most useful to you? Please rate the following 
suggested aids, considering what you would mos t like to have - ' o * mos t uigently 
need — for your current 'on the job' work as a change agent. 

Good No Not , ,A Bad 

Esse n t i a 1 Idea Op i n i on Necessary Id ea 



a. An additional section: 
"Preparing for the Role 
of Change Agent" 

b. Check lists of 'proce- 
dures ' or 'points to 
remember' for each of 
the stages 

■ ' c. Training programs to 

accompany the handbook 

d. An appendix of names 
and addresses of 
other change agents in 

/ settings similar to 
^yours 

\ 

e. Other (please specify: 




) 




O 
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Section III: EVALUATION OF CECAT BASED ON POST-CONFERENCE REACTIONS OF 
PARTICIPANTS* 

yfi e participants of the Conference on Educational Change Agent Training, 
(CECAT) , held on May 2 5~ 2? , 1970 in Clinton, Michigan, were asked t.o fill 
out' an extensive form evaluating the effectiveness of the conference,** 
Forty-one parti c’ parits completed this ;orm, ^presenting about 30% of those 
who were able to stay until the end of the conference. in addition to eva 1 - • 

uating the activities of the conference itself, participants were asked to 
evaluate the background readings and the printed conference materials which 
were sent out to them before the conference. The questionnaire also solicited 
their views on post-conference action possibilities, in this section we will 
report on the participants' evaluation of these four areas, 

A. Background • Readings 

The background reading materials were intended to provide all participants 
with a common base of know 1 edge regarding processes of innovation, planned 
change and k now ledge utilization. It was noped that these mate rials wo u 1 d 
prove to be sufficiently comprehensive, and stiumlating so that we would be 
successful in our attempt to derive impl i cations relevant to change agent 
training. 

The pa rt i c i pants were asked to give their opinion as to the value of each 
of the reading materials as background to the CECAT conference. They .were also 
asked whether they considered each literature source to be a "must" item in 
the training of change agents. The responses to these questions are tabulated 
in Table 111,1. Since not all participants had read each of the background 
sources, the percentage responses reported *n this table are based only on the 
number of respondents who indicated they had actually read the materials. 

[insert Table 111.1 here] 

Since we felt that it would-be uni ike ly/ that a H participants would have 
time to read all of Planning for innovation (approximately 500 pages), we 
directed their attention particularly to chapters 7. (Roles) and 1 1 (Summary)' 
as being the most relevant. On the evaluation form we askwd for separate 
ratings of these two chapters and for a rating of all other chapters combined. 
Table" I I I 1 ■ Indicates that participants did indeed find chapters 7 and 11 to 
be particularly useful In preparing for this conference, with 31 ,k% of 
respondents r.ega rding chapter 11 as either very useful or essential, and 86,94 
rating chapter 7 in one of these two categories. • 

Since we were particularly concerned about participants' reactions to the 
"Guide," (Prototype #3), we asked ‘for separate ratings of each section of this 
book. We were very pleased with the responses as a whole and felt that for 
a conference of this type the higher ratings for the Introduction and the six 



*Th i s section was prepared by Mary C, Havelock, • 

**A sample "CECAT Evaluation" form is included as Appendix A of this section. 
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TABLE I I i . 1 \ Evaluation of Background Readings 

i Percent Ra i i nys* 




Ni 

t 

t 


jmber Re~ 
aond i ng 


Usefulness in Preparing for CECAT ■ ] 


L h i'll t i d 1 
f p r d 
Training 
Prog ram 


0 Th i s ‘ 

1 tern C 


No |f 
)p i n i on 


'lot Very! 
Useful 


So mew ha 1 1 
Useful 1 


Very i < \ 

Useful • jEssent i a 1 ’ Total 


Planning fo r 
1 nnovat i on ; 

Summary Chap- 
ter ( 1 1 ) 


39 


'a 

0 


9 

1 

i 

i 

i 

0 i 


— ** ■ _ - r 

9 ! 

' 1 

1 
! 

l 


Oy j 0/ 0/ ■ 

-'O f A3 "j ! 

41.0 ' i 56.4 100 


60,0 


Roles Chap- 
ter (7) 


38 


0 


0 1 


i 

13.2 


47.4 39-5 100 


34.2 


Other Chap- 
ters 


27 


0 


■ 0 


40.7 ' 


j 

1 

44.4 ■ 14.8 100 j 25-9 


TOTAL 


104 


0 


0 ' 


16.3 j 

i 


44.2 | 


1 • 

39.4 100 41.3 

! 


Gu i de to 
1 nnovat i on : 

1 n t roduct i on 


35 


i 

0 


i 

1 

2.9 i 


| 

1 

1 

I 

• n .4 


« ! ' 

45.7 ! 40.0 100 : 


■ 45-7 


Case Studies 


36 


0. 


13-9 


22.2 1 


44.4 : 19-4 100 


33.3 


Stages 1 - VI 


35 


0 


2.9 


14.3 • 


) 1 

1 4Q.0 


1 , 

42.9 ; 100 : 


- 51.4 


Appendix A : 

S t i n teg i es 


30 


3-3 


3-3 


20.0 


; - - - 5 | 

1 

43.3 ; 30.0 1 100 


40.0 


Appendix B : 

1 nfo. Sources 


31 


0 


12.9 


25.8 


38.7 


22.6 : 100 


45.2 


Append i x C : 

B i b 1 i og raphy 


30 


0 


23.3 


13.3 


33.3 


I ! 

30.0 1 100 i 


■43.3 


TOTAL 


197 

i 


' 0.5 


9.6 


17.8 


i 

u. 1 

-L — . 1 


31.0 i 100 

I 1 

1 ... . . - • • 


r "■ 

43.1 


Manag i ng Change 
(Rogers and 
S venn i ng) 


- - 




3.1 


/ 

(31.3 


43.8 


18.8 


\ 

i 

i 

i 

100 


34.4 


Using Resea rch 
For Change 
(Watson) 


33 


3.0 


12. 1 


( , 

N 

\ 

36.4 


39 - 4 


9.1 


100 


21.2 


The Planning of 
Change (Benn i s , 
Ben ne £ Chin) 


* 

19 


0 


0 


. 5 -3 


! 57.9 


36.8 


i 100 

1 . - . 


52.6 



'"Percents are based on the number who responded to each item, 
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chap tc»'s on the stages of the planned change 
80% of respondents considered these sections 
essential. If, was also predictable that, of 
(Strategies and Tactics) would be considered 
of conference. 



p rocess wo re approp r i at e . Ov 
to be either very useful or 
the appendices, Appendix A 
the most useful for this, type 



Table Mi. indicates the The Planning of Change (Bennis, Benne and Chin,' 
W as potentially an excellent choice as background reading; ^.7% of those who, 
read it found it either very useful or essential in preparing for the conference 
As Table I 11.1 also shows, however, many people did not have the time to read 
a book of this length. More than half of the respondents had read none of the 
book, and of those who replied to the question only about half indicated that 
they had read the entire book, with the remainder making a sampling of a 
variety of articles. 

. The other two background readings, Managing Change (Rogers and Svennincj) 
and Using Research for Change (Watson) were apparently not such good choices, 
but these were considered at least somewhat useful by most of the participants. 



Table I'll.! shows that the materials which were rated as most useful in 
preparing for Cl* CAT were also generally considered to be most appropriate for 
use in the training of change agents. The Planning of Change and Chapter 11 
of Planning for Innovation were again the most highly rated, with most sections 
of the "Guide" also being considered quite important. 



Somewhat surprising, however, is the fact that only 3^.2% of respondents 
felt the chapter on roles (Chapter 7) of Planning for Innovation to be a must 
for change agent training. We also felt thaj; while the case study section of 
the "Guide" might reasonably be considered of lessor value in preparing for 
CECAT, it would be of key importance in making the "Guide" useful in the train 
ing of change agents. Howe vs r , only one third of respondents felt thM to he 

tlie case. 



Parti c i pan :s we re as ke d i f t hey .had addi t i on a 1 react i o ns o f co rnme n t s on 
the background reading and 15 % of them did. The most common' comment was to^ ^ 
the effect that the readings were appropriate and relevant. A number of people 
commented that they felt exceptionally well prepared for the conference and that 
their involvement was increased by our asking for their reactions to the reading 
prior to the conference. One respondent commented that the readings createe 
an attitude of participation and involvement In something that was going to be 
mean I ngful . " 

There was also some sentiment that there was too much material to read 
and that either summaries of the literature should have been prepared or else 
that special attention should have been directed toward certain key sections 
as was done in the case of chapters 7 and 1 1 of Planning for innovation . One , 
respondent wrote "Too much was expected for the length and type of meeting 
scheduled. Even if I had read everything there would not. have been the oppor 
tunity to bring the learnings to bear most productively." Another participant 
summed it up by saying "I thought all the readings were highly relevant but 
feel many participants did not read them all." 




G7 
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\:,j ^ iso asl ed participants what rending materials they would take ol f 
(h, list in designing a trainlnq workshop, and whnt other readings they would 
i :i j, fifty-six percent of respondents felt l lint the rending list should 
(' cut down i n some way; Table 111,2 shows ttie percentage of respondents 
iq deletion of each of the background readings. 



i v ; ') ' ni 



TABLE I I 1.2 



Background Readings to be Deleted from 
Reading List for Training Program 
Percent Ratings* 



Percent Favoring Deletion 



1, Planning 


^ ~ ~ — - - - - - — 

for Innovation: All 


7.3 

2.4 




PI a n n i n g 


for Innovation: Early Chapters 




2 . hu i de to 


1 nnova t i on 


0 




3 . M u nag i n g 


Change (Rogers and Svenning) 


CO 
— T 




k . Us i nq Res 


ear oh for Change (Watson) 


19.5 




A, The Planning of Change (Bennis, Benne 


12.2 




£ Chin) 


: A 1 




The 1’ 1 ann 


i ng of Change (Bennis, Benne 


2x4 




& Chin) 


: Some Sect i ons 




u 4 U n s pec i f i 


ed 


7.3 





oca 



rRorr^nfs are based on all 41 
Forms . 



55.9 

who handed in CECA F Evaluation 



V / 

s, __x 

9 
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This table shows that although there is a general feeling that there is 
too much reading material there is no clear ag reement as to exactly how i t 
;> ho y 1 d be cut dow n , P rob a b 1 y mos t parti c i pan t s wo u Id be satisfied if 
the Watson article were deleted and .If only certain sections of Planning for 
Innovation and The Planning of Change were assigned, \ 

Participants had a wide variety of suggestions as to what might be added 
to the reading list for a training workshop, hut- here there is virtually no 
consensus at all. Eighteen people suggested spec i f i c^add i t i ons , but only- 
one article received as many as two mentions! thrs-'was the monograph "Change 
in School Systems," a COPED-NTL publ i cation edited by Watson.* Several people 
did suggest that some readings should be added which covered the R&D approach 
more thoroughly. 

*Ava'i 1 ab 1 e jjrom NTL-IABS, ) 201 Sixteenth St., N.W., Washington, D.C. One of 
two paperback volumes edited by Watson for COPED. (The other is Concepts 



for Social Change"). $2.50 each 



or $4. 50 for set , 

PR 
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B. 



Printed Cor ference Material's 



In add i t i or, to the backg-qt d readings, several types of printed materia 
WfJ |- c sent to participants before the start of the conference. These were de 
signed to focus attention on different approaches to the change process and 
to the training of change agents. We hoped that participants would consiclei 
these materials in terms of their own conceptual frameworks and practical 
approaches and thus develop a clear notion of how they could apply theit w’ 
experience to the task of the conference. The pa r t i c i pan ts 1 evaluation 01 
these materials are presented ' Table III *3* 



TABLE I I I . 3 



Evaluation of Printed Conference Materials 
Percent Ra tings ,l; 



I . List of statements 
about change process 
from Chapter 11. 



No 

Op i n i on 



2 . 1. 1 s t of statements 
abr t training (by 
Charles Jun< 



3 , Listing of add i t i on 
a 1 points .made by 
participants 
Conference 



TT Letters and other 
descriptive mater. 
i . 1 1 $ -f rom CECAT 

Total 



7.3 



3.8 



9.8 



12 . 2 



9-8 



Not 

Very 

Useful 



22.0 



29.3 



36.6 



14.6 



25.6 



Some - 
who t 
Usefu 



22.0 



41 .5 



39 .O 



0 



31 . 1 



Useful 



Essentia 



31.7 



14.6 



1 1 .0 



36 . 6 



23.5 



17- 



4.9 



3-7 



14 .6 



10 . 



Total 



100 



100 



100 



100 



100 



.''Percent responses based on all 41 participants who turned in CECAT Evaluation 
Forms , • ■ ' 



The list o" statements about the change process derived from Chapter 11 
of Planning f or Innovation were qui te 'favorably rated; it was to these that 
parti ci pants had been expfi ci tly requested to react. All participants had 
been asked to fill out a form indicating their judgment of the importance of 
the topics in this list and to prepare to lead a d i scuss ion i n ^ the area in 
which they considered themselves to be particularly well-informed. This device 
was considered very favorably by some; one participant commented "Your efforts 
spent listing the key points of each change process model paid off extremely 
we 1 1 . Your procedure for forcing people to select topics t.o report, on was a 
master stroke." Not all participants shared this view, however. There were 
- those who felt that not enough use was made of this, preparation; one partici- 
pant wrote "the advance materials and feedback were excellent - but we didn t 
build on these to the degree we should have." Other participants felt that 
these preparations were not relevant to the conference task; one respondent 
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commented "although the statements on the > tange proce 
for discussion,... I don't believe this contributed to 
i n g . 1 1 



s provided a basic 
thoughts about train- 



The list of .statements about training prepared by Charles .Jung should 
have appealed to those who were dissatisfied with the focus of the change 
process statements. However, as Table I i I .3 shows, this list was not 
considered to be quite as useful. Part of the problem here seemed to be that 
this list was not sent out soon enough, and several people commented that 
there was an insufficient attempt made to focus discussion on it. 

The listing, of additional points made by participants was viewed by some 
people as superfluous, but others found them particularly stimulating, and 
a number of very 1 ively discussions on these points were held at the conference 
on Monday evening. 



Whatever the relative merits of the different pre-conference materials, 
collectively they seem to have effectively fulfilled the objective of pre- 
paring the participants for the conference and involving them in the task. 

One participant commented "I have never felt so well prepared for a conference 
as I was for this one." 

C. Conference Ac tivities 

Participants were asked to evaluate each separate session of the conference 
well as its general aspects. These responses are presented both as percent 
ratings and mean ratings in Table III. ^4* 

[insert Table I II . k here] 

One participant wrote "I do not believe that these questions really get 
at the essence of what, was. to me a very powerful experience." Perhaps this 
was true for a majority of participants, since, as Table III. k shows, the 
conference as a whole received a higher rating than did any of its individual 
parts with the exception of 1 'opnortun i ties ava i 1 ah I e for informal discussion." 
Informal contacts were in fact a key to the success of the conference from 
the point of view of many people. The conference was described by some as the 
best opportunity they had ever experienced to carry on informal conversations 
with a wide variety of stimulating and well-informed colleagues. One parti- % 
cipant described the gathering as "an unusual collection of experts." 

The mean rating of only 3-1 for the design of the conference Indicates 
that we made some errors in judgment here; participants on the average were 
only "somewhat satisfied" with the design. There was some disagreement as 
to whether the conference was structured too rigidly or too loosely, but 
the primary criticism was that not enough time had been allotted to the work 
in the task force groups. 

From the percentage ratings in Table I I I .A we can see that there was 
quite a range' of opinion as to the success of the 'meet i rigs which were held 
on Monday and. Monday evening. This range can be largely explained by the 
varying success of each of the six subgroups .as rated by its own members. 
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TABLE i M . 4 



E j a 1 u a t i o n o f_ Cor, f e rer ce As t i v i t i e s 
Percent Ratings and Mean Ratings*' 



’ / 
U 



f hcan 
| Rat i ng- 



16 . 



-Percents and means are based on the number who responded to each item. 
© A* g = "one of the best I have attended"; 1 = "very dissatisfied" 

eric: 



Who Re- 
sponded 
to. t h i 
1 tem 1 


Vet* y 
0 i s s a t - 
i s f i ed 


Somewha t 
Dissat- 
isfied 


Somewhat 

Satisfied 


Quite 

Satisfied 


] 

Very 

Satisfied 


HThe‘~oT 
the best 
1 have 
a t tended 


j 

i 

Total S 




Con f e rence 
as a whc e 


41 


0 


4.9 


17.1 


39-0 


32.9 


6 . 1 


1 00 


4.2 


Design, of 
confe rence 


41 


2.4 


31 -7 


31.7 


17- 1 


17. 1 


0 


100 


3.1 


Orientation 
Monday 9am. 


36 


2.8 


13-9 


19.4 


44.4 


16. 7 


2.8 


100 1 


3.7 


Change Pro- 
cess D i s- 
cusj ions 
Monday 


39 


10.3 


15-4 


20.5 


!vjo 

; o 

■CO 


23- 1 


0 


100 


3.4 


Group Sum- 
maries - 
Mo n d a y 
C o c t a i 1 


36 


8-3 


13-9 


36. 1 


36.1 


5-6 


0 


100 


3.2 


Monday 
even i ng 
sess i on 


28 


14.3 


3.6 


28.6 


17.9 


25.0 


1C .7 


100 


3 . 7 


Training 
'Panel - 
1 ut"> . a . m . 


36 


8.3 


23-6 


23.6 


30.6 


11.1 


2.8 


100 


3.2 


Training 
S tatements 
G roups “T ties . 


35 


8.6 


8.6 


34.3 


37 .; ! 


11.4 


0 


100 


3.2 


Group Sum- 
maries - 
T uesday 
Cockta i 1 


23 


4.3 


17.4 


'47.8 


26. 1 


4.3 


0 


100 


3.1 


Your Task 
Fo ree & its 
P roduct 


31 


3.2 


1 1-.3 


24.2 


22,6 


- 

35.5 


3.2 


100 


3.9 


Other Task 
Force Pro- 
ducts 


39 


0 


20.7 


31 .0 


27.6 


20 . 7 


0 


100 


3.5 


D i scuss i on 
Critique of 
Task Force 
P roduc ts 


25 


0 


44.0 


28.0 


20.0 


8.0 


■ 0 


100 


2 . 9 , 


! mp 1 emen ta 
t i on -Pol low 
through 
d i scuss i ons 


13 


10.5 


21.1 


47.4 


10.5 


10.5 


0 


100 


. 2.9 


Co if e rence 
S i te 


38 


31.6 


26.3 


23-7 


10.5 


7,9 


0 


100 


2.2 


Opportun (ties 
for info rma 1 
d i scuss ions 


38 


0 


5-3 


1 5'. 8 


23 . 7 . 


50.0 


5.3 


100 


4.3 


Your own 
con t r i bu t i on 


38 


2.6 


25-0 


48.7 


21 . 1 


2.6 


0 


100 


3-0 
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f ho ugh the mean rating for all change process group discussions (item # 4 ) 
was 3.4, the mean rat ings ol the individual sub-groups ranged t rom 2.5 to 
4.3. An even greater disparity occurred for the Monday evening sessions 
(item it 6 ), for which the suh-f roup ratings bv their own members ranged from 
1 . 7 to 5 . 5 . N 

The panel discussion on training which was held on Tuesday morning 
(item § 7 ) provoked many comments, which varied from disapproval to enthusias- 
tic appreciation. Though described by some as s t i mu 1 at i ng and on target, 
the panel was felt by others to be lacking in planning and structure and to 
be unrelated to the outcome goals of the conference. The panel members them- 
selves gave the panel a mean rating of 3 . 0 , slightly lower than the rating of 
3.2 which it received from all participants. g* 

Though participants expressed some d i s sa t i s f act i on with the early activities 
of the conference, they were quite p. 2 c.sed with their primary task activity, « 
the designing of training programs in Lusk force groups. As* with the Monday 
groups, there was considerable variation in the self-ratings of the different 
task force efforts by the members of each group. Here we notice an interesting 
relationship between task force size and satisfaction with the product created. 
There were four large groups (5 to 7 members) which gave themselves mean ratings 
which fell between 4.0 and 4.5. Two groups each had two members; one of these 
rated Itself as 5*0 - the highest rating received by any group - and the other 
gave itself a rating of 3 - 0 - Four participants chose to work alone, and these 
people gave themselves ratings of only 2.0 or 3-0. This could be explained 
partly on the basis of modesty of the solo workers. More likely the experience 
of co 1 1 abor a t i ng in a g rou p ■ is emo t ionally and intellectually stimulating, with 
the sharing of diverse ideas yielding a richer and more exciting product. We 
might also speculate that choosing just one partner with whom to work may be 
a chancey proposition. The only criticism expresse J about the task force groups 
was that there was insufficient time to do justice to the assignment. 



Participants generally liked the products of their own task force group 



slightly better than they did those of other group 
own group as opposed to 3 • 5 for other groups). It 



poop 



Wou 1 



n iW ^ fc. 



en thus * 3 s 1 1 



abou i 



the i r own 



s (mean rating of 3.9 for 
would stand to reason that 
areas of interest, but in 



addition to this the press of time at the end of the conference did not allow 
for a thorough total-group discussion of the task force products. This dis- 
cussion (item # 12 ) received a low rating because of this time factor. 



The discussion on implementation and follow-through of training designs 
(item # 13 ) received a similarly low rating, also because of inadequate time. 

We were somewhat surprised that participants gave their own contribution 
(item #16) a mean rating of only 3 . 0 ; wo would have expected this rating to 
be very close to that of the task force group ratings. Many people felt they 
had insufficient time to write and contribute as they would have liked, and one 
person commented "1 gained more than I contributed." But another participant 
who was very satisfied with his performance stated "I worked hard and I liked 
it," 

/ 

Finally, Table I! 1,4 shows that the site of the conference was its least 
satisfactory aspect, and we. received the most numerous and most colorful comments 
on this item. There was agreement that the food was good and the setting was 
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pleasant, with its remoteness being fudged as an advantage. The accommoda- 
tions, however, were described/by some participants as "spartan" and "primitive." 

S.n order to probe more cfcsph *nto participants' feelings about the 
conference, we asked them to comment on what specific part of .the conTeienco 
they found most meaningful and from which part they learned the most. The 
comments made in response***© these questions are summarized in Table II 1-5. 

The percents in this table are based on the number of participants who re- 
sponded to each question, 

TABLE MI.5 Conference Activities Which Were Judged The 

Host Mean i ngful and The Best Learning Expe r i ence 

Percent Ratings"* 



What part' of the con fe "ence did 
you find most MEAN i NGFUL? 

(35 responses) 


Pe rcent 


From what part of the confer- 
ence did you LEARN THE HOST? 
(34 responses) 


Pe rcen t 


Task Force work 


. 3 


Task Force work 


^ 0 => 


1 n forma 1 contacts 


22.9 


Monday group sessions 


26.5 


Monday group sessions 


14.3 


1 n formal contacts 


17-7 


P re - con f e rence background 
reading 


2.9 


Pre-conference background 
read i ng 


14,7 


Group feedback and synthesis 
sess i ons 


2,9 


Group feedback and synthesis 
sess ions 


2,9 


Training panel 


2.9 


\ 

* 




TOTAL 


1 00 


TOTAL 


1 00 



'"Percents are based*on the number of responses to each question.. 



* We were pleased to find that the task force group work was regarded as bei.ng 
the most meaningful activity as well as providing the greatest opportunity for 
learning. The high rating of the value of informal contacts illustrates again 
the fact that the conference participants represented a very unusual gathering 
of highly qualified experts in interrelated branches of the field of education. 

We find hoped to design CEGAT in such a way as to make it a model for future- 
gatherings of this type. To find out how well we had succeeded in. this aim we 
asked .parti ci pants to indicate whether there was anything they would have liked 



0 
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to have done more of and whether there was anything they would have liked 
to have done less of. The comments we received in response to these question 1 .', 
are summari zed i n Table I I 1.6. Here Che percents are based on the 41 respondents 
who handed in the evaluation form. 



TABLE ill. 6 Conference Activ ities .Judged to Have 

Occup i ed Too Little or Too M uch T i me 
Percent Ra t ! ngs* 



What would you have liked 
to have done more of? 


Pe rcen t 


[ 

What would you have liked , 

to have done 1ess_ of? 


Pe rcen f 


More time in task force 




Monday group discussions 


1 2.2 


groups 


19.5 


Random discussions 


12.2 


Synthesis and total -group 
d i scus s i ons 


9.8 


"Impressing eac" other" 


12.2 


Sharper definition of task 




0 1 he r 


17.1 


force assignments 


7-3 


Nothing - conference design 




Discussion of values issue 


4.9 


was satisfactory 


12.2 


1 nforma! meet! ngs 


4.9 


No response 


34.1 


Work on other conference 
ma t e r i a 1 s 


4-9 


TOTAL 


100 


0 the r 


22.0 






Nothing - conference design 
was • sat i sfactory 


7.3 






No response 


19-5 






TOTAL . \ 


100 


. 





^Percents are b; sdjd on all 41 respondents who handed in CECAT EVALUATION forms. 

/ 

These responds indicate that the conference would have been viewed more 
satisfactorily if we^ad begun the task force work sooner , cut t i ng down the 
time spent in discussing *he change process and the participants' own points 
from all day Monday to on!/ a portion of that day. If we had done this we 
might also have cut down on the amount of "random discussion" and "impressing 
each other." Running through the comments which we have grouped under, these 
two headings was the general feeling that a number of people were not getting 
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down lo work and applying themselves to the task of the confe.enco. iPihap.i 
a sharper definition of the task force assignments at an earlier time would 
also have helped to alleviate this problem. 

We were aware, in addition, that not enough time had been set aside at 
the end of the conference for critique and synthesis of the task force products 
This problem was heightened by the fact that a number of people had tb leave 
early to catch their flights for home, but: this type of problem is one which 
should be taken into account in the design of any conference of this size. 

The headings "other 11 in Table 11,1.6 include all the activities which 
were each me ntioned by only oneparticipant as occupying either t oo much or 
too little time. . They included such things as the des.i re for more process 
discussion, interaction with conference principals and interaction with people 
who we re work ing In other groupstand the desire fc** 1 ess of an "NTL" type 
approach and of moving around from large to small groups, 

D . Post— Conference Action Possibilities 

1 , //, hfacui for Action 

■Though the purpose. of CL CAT was to help us to arrive at designs 
for the training of change agents , we 'felt the conference would have, 
achieved something else of importance as well if it had helped the 
participants tn arrive at new ideas or approaches which they could 
use In their own work. We asked the participants if this were the case 
and also whether or not they thought these Ideas coui d be implemented 
and whether they would make an effort to do so. The responses to these 
questions are given in Table 111./. 

[Insert Table 111.7 here] 

These responses are certainly most encourag i ng ; the conference 
evidently yielded a wealth of ideas and, most significantly, participants 
are apparently eager to fol low through on them. In fact a number of 
neon 1 e plan to make an effort to utilize their new ideas even though 

i r * 

the resources to do so. are not available to them at the present time. 

The particular nature of the new ideas and approaches which 
participants derived from the conference are. summarized in Table II 1.8. 

[insert Table I I 1.8 here] 

Two task force groups In particular inspired the bulk of ideas 
related to task force products. About 77% of those who stated that the i i 
new ideas were related to task force products mentioned' the training 
programs designed by the groups working on the "macro-system" and the 
"change- th rough- cri sis" approB’ches, As well as being a source of ideas 
for those working in these groups, these two products were the only ones 
cited by others as being the primary source of their new Ideas. 
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TABLE I I I .8 



Na tu r e of New I deas and App roache s 
Pe rcent Ra t i ngs 



Nature of New ideas and Approaches 



deas : 



Related to task force products 
Own task force (33 • 3%) 
Ollier task forces (10.056)' 



Ideas: New i ns i gilts about the process of change 

Printed Resources: Found out about new materials 
to use: 

Havelock materials (6 . 7%) 

Materials from other' colleagues (6.7%) 

Human Resources: Formed new i nte rpersona 1 contacts 

Skills Learned: Group interaction techniques; 



How to set up a task force 



0 the r 



TOTAL 



Percent '• 






43-3 



20.0 



13.3 

6.7 

6.7 

10.0 



1 00 



-Percents are based on the 30 participants who res] 



to this question 



Included in the "other" category of Table I I 1.8 are some irteresting 
by-products of the conference. For example, one participant stated that 
the conference had emphatically confirmed for him the validity of the 
approach of the program he is developing in his own work. 

2. Future' Conference Possibilities 

Most participants felt the conference should be reconvened at some 
time within two years; 87-8% were in favor of this idea, while only 7-3% 
were opposed. The remaining A. 9% gave a conditional response, saying 
that it should be reconvened only if sufficient work were accomplished 
in the interim. Some of those who felt the conference should not be 
reconvened still said that they would come if it were; 92-7% of participants 
said they would attend If such an event were scheduled. Only 2 . k% said 
they would not attend and again A. 91 said "maybe." 

About two thirds of the participants had suggestions as to how such 
an event should differ from CECAT, Those who specified what the purpose 
of the conference should be felt that it; should deal with implementation 
of the training designs produced by CECAT. Some. people felt that the 




=?r 

/u- 



nature of’ t fio event should depend on its intent; for instance, one 
participant who was interested in i mp 1 emon.l i nq the training desicin 
produced bv the group working on a "macrosys terns" approach fell I ii i •• 
end might best be met by scheduling a series of meetings with key 
personnel in various government and educational agencies rattier than 
holding one large conference. 

For the most part, however, participants' suggestions were con- 
cerned with how to design a conference si/mi lar to Cl CAT , and these pro- 
posals tie in vo rv closely with the evaluation of CECAT activites described 
above. The suggestion most commonly made was that only those who were 
truly dedjcated to the outcomes of the confe rence shou 1 d be invited. 

Related to this point were recommendations that there should be fewer 
participants, that these participants should take more of. a part In pre- 
paring for the conference, and that the conference should be more 
structured around the goals desired. It was also felt that task force 
work should be started sooner and that more time should be devoted to 
total-group discussions in order to provide cross-fertilization of ideas. 

■ v 

All in all, we .find that, by the close of CECAT, participants feltk 
w, ‘ i v stimulated and highly motivated to work, >>ut they also felt frustrated 
by the small amount of time available to th^m to produce what they con- 
sidered to be quality products. They would like to meet again to follow 
through on the ideas inspired by CECAT, but they would like to put more 
effort into pre-conference preparation so that they could get down to 
the work of the conference as soon as it convened, 

We feel certain that on their own many participants will make use 
of the ideas generated by CECAT, but we alro feel frustrated that, outside 
of holding another conference, we have no device for drawing on the 
collective talents of the highly motivated and creative CECAT participants 
who are now scattered around the country. We are not alone in this senti- 
ment: one participant remarked "I would 1 i-ke to be able to tap a group 
like this for help In meeting our training needs. Perhaps some of the ' 
inventiveness possessed by members of the group could be used to invent 
a process for a productive continuing relationship." 

E. Future Need of Conference Related Materials 



The first set of questions on our CECAT evaluation form dealt with how 
useful the participants had found the background readings to be in preparing 
for this conference. We were also interested as well, however, in finding 
out how useful the participants felt the conference materials would prove 
to be in the .future in their own work. Our final question asked for this 
information; the responses are given in Table III. 9 . 

[Insert Table I 11.9 here] 

We were please not only with the very positive response to the "Guide" 
and to PLANNING FOR INNOVATION, but also with the extremely high interest shown 
in obtaining copies of the CECAT r ' -'oceed i ngs . Perhaps this response indicates 
more clearly than any other that e participants felt the conference had pro- 
duced valuable results. 
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TABLE I I 1 .9 . Evaluation of Future Need for Conference 

Related Materials 
Percent Ratings* 





Number Re- 
spond i ng 
to this 
1 tem 


Not Likely 
to have 
a Future 
Need 


Might be 
I nterested 
at some 
t i me 


Definitely 
i nterested - 
1 have peo- 
ple or events 
in mind 


TOTAL 


CECAT Proceed- 
ings (including 
Task Force 
Plans) 


35 


2.9 


25.7 


- ' 

, 71.-4 


.100 


PLANNING FOR 
INNOVATION 


33 


0 


48,5 


51 - 5 


100 


GUI DE TO 
INNOVATION 


33 


0 


45-5 


54 . 9 


100 


MANAGING 
CHANGE 
(Rogers and 
S v e n n 1 n g ) 


29 


17.2 


41.4 


41 .4 


100 


"Doing Ro- 
se.) rcli for 
Change 1 1 
(part of 
Watson re- 
port) 

—a - 1 r - 


i 

28 


25.0 


% 

28.6 


46.4 


100 



^'Percents are based on the number who responded to each i :em. 
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Section III 
APPENDI X A 



CECAT Eva 1 u at i or 





Form 




Indicate sections 



CECAT EVALUATION 



Name 



1 . Background Readings 



Value as 
backg round 
to this type 
conference 



f 

C 



~\ 



TO 



1.. PLANNING FOR INNOVATION Summary Chapter (11) 



Roles Chapter ( 7 ) 



Other Chapters 



2, GUIDE TO INNOVATION: Introduction,,, 



Case Studies 



1 1 



"Stages" I -VI 



Appendix on Strategies 



1 1 



on Information Sources 



■ i 



Change Bibliography 



i e 
TO 
TO 



ID 

O 



CL 

o 

O 



3, MANAGING CHANGE (Rogers & Svenning) 



A, USING RESEARCH FOR CHANGE (Watson) 



5, THE PLANNING OF CHANGE (Dennis , Benne , and Chin) 



"O 




TO 




TO 




L- 




LO 




TO 


< 


U 




#**=■ 


: ■ 


-M 




U 


c 


TO 


TO 


U 




O 





O 
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6, . Do you have any additional reactions or comments on background readings? 



7. In designing a training workshop, what reading materials would you take off 
this list? 



8, What other readings would you add? 
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Printed Conference Materials: 



A number of handouts were especial ly prepared fur CECAT. Which ones 
turned out to be useful in facilitating conference work? 





No 

Opinion 


Not Very 
Useful 


Somewhat 

Useful 


Very 
Usef u 1 


Essen t i a 1 


1. List of statements about 

change process from Chapter 11 
(used as basis of Monday's 
d i scuss i ons) 












2. List of statements about, 

training (by Chic Jung) 
(used as basis of Tuesday's 
A, M, d i scuss i ons) 












3. Listing of additional points 

made by participants prior 
to conference 












k . Letters and other descriptive 

materials from CECAT 












5. Other (spec i fy) : 













6. Additional comments on Conference materials: 
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iii, Con f e re nee Activities; 



How satisfied were you with each of the major elements of the conference? 
Add comments to each item as you feel necessary. 
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Conference Activities, continued 
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1 7. What specific part of the conference did you find most i'.^AN I NGFUL? (Please 
specify kind of activity and content.) 



1 8. What part did you LEARN THE HOST from (kind of activity and content)? 



19, Anything you would have like to have done mo re of: 



20, Anything you would have like to have done less of: 

v 

k 

V ■ ■ 
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IV. Pos t- Con fe rence Action Poss i b t 1 8 1 1 es : 



1 . 



Did the conference help you arrive at any new ideas for 
take or approaches you could try In your work? 



i on you cou 1 d 



def I n i te 1 y 




not re a 1 1 y 



Briefly describe any such ideas you did get? (If these ideas are related to 
Task Force* products, indicate which Task Force and how related.) 



2. In your opinion, would it be possible to implement 
condi t ions? 



these Ideas under existing 



3 - 



I (we) could i m- , it would take resources, 

plement them under , . skills or money not avail- 

existing condi- , ' able to me (us) 

tions. 

What do you think the chances are that you will actually try to follow through 
on any of the ideas you listed in Question i V— 1 . 



really doubt I'll try 



really expect I'll try 



4, In your opinion, should this 
two years? 



conference be reconvened at some time in the next 



No 



5. Would you participate in such an event If it were held? 

.Yes No 



6 . In what ways shoul d such an event di ffer f i m CECAT? (Please answer on back side.) 



* 



/ERIC 
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V ■ Fuiuro Need of Conference Related Materials 

All of the materials provided for CECAT in addition to the CECAT proceedings 
will be available in quantity for future use in training activities. We wou Id like 
to have your estimate of possible future use by you or the organization you re- 
present. For non-Michigan products v.e will relay the information you provide. 



CECAT Proceedings (including 
the Task Force Plans and pre- 
Conference feedback) 


Not 1 i kel y 
to have a 
future need 
for this. 


Might be 
i n te res ted 
in addi- 
tional copies 
at some t i me . 


De f i n i te 1 y 
interested: 1 

have people 
and/or events 
in m i n d . (\ n - 
dicate approx, 
number of 
copies if 
pos s i b le .) 


1 

M will be 

ready to 
order as 
soon as 
they are 
available. 
(l nd i cate 
number of 
cop i es .) 


Th i s j p 
an. o r de r . 
i wou 1 d 
1 I ke you 
to send 
this num- 
be r of 
cop i es . 












1 'l 

PLANNING F10 R INNOVATION 
($8.00 pe r) copy) 












GUIDE TO INNOVATION 
( $3 ■ 00 per copy) 












MANAGING CHANGE (Rogers 
and Svenning - $1,00 
per copy from PEP) 






' - 






DOING RESEARCH FOR CHANGE 
(Part of Watson Report 
wh-Ich will be available soon) 


1 










Other materials or books 
which came to your attention 
during our meetings. 

(Spec i fy) : 


/ 






1 




n * i n = . 







Billing Address (if appl i cable) ; 



O 

ERJC 
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